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ABSTRACT 

Xn this thesis four design problems are considered: two on the 
optimal minimum order observer-based compensator design and two on the 
optimal limited state variable feedback controller. 

Chapter II considers the problem of designing an optimal discrete 
time linear time-invariant observer-based compensator for the regulation 
of an n dimensional linear discrete time time-invariant plant with m 
independent outputs. This is a stochastic design problem to the extent 
that the initial plant state is assumed to be a random vector with 
known first and second order statistics. The coitpensator parameters 
are obtained by minimizing the expectation/ with respect to the initial 
conditions, of the standard cost, quadratic in the state and control 
vectors with the inclusion of cross terms. The time interval con- 
sidered is £0 / +“) . 

The eirphasis is on the necessary conditions for optimality. It 
is shown that for a given plant in state— output canonical form the 
optimal compensator parameters are non unique but are related by a 
similarity transformation on the observer. Questions on the nattire of 
the Riccati equations obtained as well as the invariants of the design 
under a state-output similarity transformation are answered. 

Chapter III deals with the discrete-time version of the optimal 
output feedback controller problem. This problem is treated on the 
basis of solving two discrete-time versions of the optimal limited 
state variable feedback controller problem [Jl;S2], Two different 
design methods are presented. The emphasis is on the necessary condi- 
tions for optimality. 

In Chapter IV the optimal limited dimension control problem for 
linear systems is tackled in the context of aggregation theory lAl] . 
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The analysis is done in continuous time for the sake of notational 
sinplicity. 

Chapter V considers the problem of designing an.ophjual time- 
varying observer-based conpensator for the regulation of a linear time 
varying plant with a known input disturbance. The initial plant state 
is assumed to be a random vector with known first and second order 
statistics. The compensator parameters are to be obtained by mini- 
mizing the e:pected value, with respect to the initial plant state, of 
the standard cost, quadratic in the state and control vectors. The 
time interval of interest is [0, T] . The analysis is in continuous 
time and stresses the necessasry conditions for optimality. The eirphasis 
of the chapter is in showing the separation property of the design 
method proposed. That is, the control and state reconstruction problems 
are decoupled and can be solved independently. 
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CHaPDER I 


I. I Brief Historical Review 

aniong the many contributions of Professor R.E. Kalman to the 
modem control theory is the rigor<ius formulation of the linear state 
regulator problem and its solution in the context of the calculus of 
variations £Kl], The philosophy behind this design criterion is to 
obtain an optimal closed lopp system with the property that deviations 
from the nominal plant st^ite are kept near zero without excessive 
e^5)enditure of contro^fenergy. The problem was formulated as a com- 
pletely determinisl^ one; namely, the initial condition vector was 
assumed to be knoKh' completely. Basically the solution to this 
problem leads an optimal feedback control law which requires know- 
ledge of the whole state vector. VJhen this formulation and solution 
/ 

are analyzed /from the practical point of view we find that they con- 
stitute an i,dealization of a real problem in the sense that quite 
often neither the initial condition vector nor the coiaplete plant 
state vector are available as measurements. For this reason the 
problem was reformulated as a stochastic one to the extent that the 
initial plaint state was assumed to be a random vector with known first 
and second order statistics. The cost was also modified to be the 
ensemble average cost due to the random initial state. Surprisingly 
enough, it turned out that when the problem was formulated in this 
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way, the optimal (in an "average sense") control law obtained was the 
same as in the completely deterministic case. The technicality of 
the absence of conplete state measurements now had to be solved. 

Guided by the previous results (that the optimal control law is a 
linear function of the state vector) a reasonable approach for solving 
this problem would be to reconstruct or approximate in some sense the 
plant state vector. In fact, Luenberger [L3] proposed the use of an 
"observer" to reconstruct asyrptotically the state vector based on all 
the available info3nnation (plant model and measurements) . Of course, 
the state reconstructor is not the only solution to the problem of 
regulating the plant state. For instance, in 1969 Levine [LI] proposed 
the use of an optimal output feedback controller. In these design 
methods the optimal control law is a linear function of the measurement 
vector. This latter design technique may have important practical draw- 
backs that force the designer to use a dynamic compensator. Namely, 
sometimes the plant cannot be stabilised by means of output feedback, 
or the performance is not satisfactory for the application at hand. 

The deterministic Luenberger observer design has a slight draw- 
back: the observer parameters may be selected rather arbitrarily. This 
motivated some researchers (Nev/mann [Nl] , Y&sel and Bongiomo [Yl] , 
Miller [Ml], Rom and Sarachick [R3], Blanvillain [b 2] and many others) 
to determine the compensator parameters (control law plus observer) by 
minimizing a performance index. V?hen posing this optimization problem 
the following two facts are strongly considered: the initial plant 
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state is seldom Icnown perfectly and second, if the initial plant state 
is knovm perfectly then a Lueiaberger obseirver, with arbitrary dynamics, 
can be designed so as to reconstruct perfectly the conplete state. 

These are reasons for treating this optimization problem in a stoc has tic 
context. Another important point, when this problem is being formu- 
lated, is the dimension of the observer, (n-m) * was selected because 
it turns out to be the minimum dimension the observer should have in 
order to reconstruct asymptotically with the aid of the output vector, 
the entire state vector (see Luenberger [L31). All these elements gave 
rise to what is called the optimal minimum order observer-based com- 
pensator problem- An approach to this problem in continuous time was 
proposed independently by Miller [Ml3 , Blanvillain fe2] and possibly 
by others. The second chapter of this thesis considers the discrete 
version of this problem. We note that very recently approaches 
to this problem had been proposed independently by two ai-thors. 

Roberts [Rl] mimicking Blanvillain’ s approach only presented the 
necessary conditions for optimality. O’Reilly and Ne;-nnann [01] tackled 
the problem guite similarly to the present treatment but took one of 
the design parameters to be the identity matrix. 

Several approaches to the reduction of compensator dimension 
have been reported. The work of Johnson and Athans [Jl] is one such 
contribution. In this paper, the compensator structure is assiuned to 

* n - dimension of the plant state vector 

m - dimension of the measurement or output vector 


be of a fixed form and a gnadratic cost is introduced in order that 
the problem be wall .posed. Later in 1975/ Sirisena and Choi presented 
a slight modification in tJie performance index. One of the major 
advantages of these two formulations is that the problem can be refor- 
mulated (via a.ugmented matrices) as in Levine’s optimal output feed- 
back controller problem. For this reason Chapter III presents the 
discrete time version of the optimal output feedback controller problem 
Two completely different approaches are presented/ so as to give more 
insight into the problem issues and as ways of presenting useful dis- 
crete time optimisation techniques. We also present an approach to 
the optimal reduced order compensator problem via Aoki's aggregation 
theory. This is the subject of Chapter IV. 

l.ll Outline of contents 

. In .Chapter II the problem of designing an optimal ^screte time 
linear time-invariant observer-based compensator for the regulation of 
an n-dimensional linear discrete time time-invariant plant with m 
independent outputs is considered. It is assumed that the initial 
plant state is a random vector with knoi-^n first and second order sta- 
tistics. The performance index is taken to be the expectation, with 
respect to the initial conditions, of the standard cost, quadratic 
in the state and control vectors with the inclusion of cross terms. 

The time interval of interest is [0, 4«) . The emphasis is on the 
necessary conditions for optimality. It is shown that for a given 
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plant in state output canonical fom the optimal compensator parameters 
are non-unique but are related by a similarity transformation on 13ie 
observer- Questions on the nature of the Riccati equations obtained 
as well as the invariants of the design under a state-output similarity 
transformation are answered. 

Chapter III deals tvith the discrete-time version of the optimal 
output feedback controller problem. This problem is treated on the 
basis of solving two discrete-time versions of the optimal limited 
state variable feedback controller problem £ J1;S2] . Two different 
design methods are presented. The eitphasls is on the necessary condi“ 
tions for optiitiality. 

Chapter IV considers the optimal limited dimension conpensator 
design problem in the context of aggregation theory [All - The analysis 
is done in continuous time for the sake of simplicity. 

Chapter V considers the problem of designing an optimal time- 
varying observer-based compensator for the regulation of a l i time- 
varying plant with a known input disturbance- The initial plant state 
is assumed to be a random vector with known first and second order 
statistics . The performance index is taken to be the expectation, 
with respect to the initial condition vector, of the standard cost, 
quadratic in the state and control vectors. The time interval con- 
sidered is [0, T] . The analysis is in continuous time and stresses 
the necessary conditions for optimality. The emphasis of the chapter 
is in showing the separation property of the design method proposed- 
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That is, the control and state reconstruction problems are decoupled 

and can be solved independently. 

The conclusions and discussion of results appear in Chapter VI. 

also, possible research extensions are discussed. 

I.III Notation arid Termindlogy 

Small boldface Roman letters will denote vectors and capital, 

letters the matrices unless otherwise stated, a* denotes the transpose 
of a, I the identity matrix and 0 the zero matrix with appropriate 
dimensions. Discrete time vectors function of time t are denoted with 

the subscript t for notational convenience. A(n x n) denotes the _ 

matrix a which is dimension n x n. It is stressed that a given matrix 
may have different meanings and dimensions according to each chapter. 
This is biecause the chapters are independent of each other in contents 
and reguired a large quantity of different matrices. 

Xf R(n X n) is positive (semi-) definite, we write R > 0 

(R > 0) ; R > Q means (R - Q) > 0. 

The expected value (ensemble average) is denoted E (usually not 
followed by brackets) . ®ie covariance natrix of a vector-valued 
random variable: 

E{x(t) x' (t) } - E^x(t) Xt)!f 

is denoted by : 

cov{x(t) } 
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A reference for 'tiie. concepts of controXlabxXity, obserrability 
and stabilizability used is W.M. Vtonbara IWl] . 



CHOTTER II 


DISCRETE«TIME OPIlMZil. MINIMUM 
OjRDER OBSERVER-BaSED COMPENSATOR 

II. I Introduction. 

In this chapter, the problem of designing a compensator with 
dynamics constrained to be those of a discrete time minimum order 
observer is considered. The necessary conditions will be developed 
for a discrete-time linear time invariant plant with random initial 
state- The cost to be minimized is the esgpectation, with, respect to 
the initial state, of , the standard quadratic cost for the discrete 
time linear regulator problem. The emphasis of this chapter is on 
the necessary conditions for optimality. A historical account of 
the problem, including salient features of observer design, is pre~ 
sented. 

5Sbi.s chapter is structured as follows. In the second section 
the discrete-time linear regulator problem is presented. The third 
section presents the structure of the minimum order observer-based 
compensator. In section II. IV the specific optimal control problem 
is formulated and necessary conditions for optimality are found. 
■Section five discusses ibriefiy how the snffioiency part the proof 
of optimality is worked out (based on Miller's paper [Ml]) . The con- 
ditions for existence of positive definite and positive semidefinite 


- 15 - 



-16- 


solutions of the Riccati equations obtained from the necessary 
conditions are given in section II .VI. The last section deals with 
peripheral issues pertinent to this problem, and discusses the rele- 
vant literature. 

II. II The discrete time linear regulator problem 

This section considers the problem of designing a full state 
feedback control for a discrete-time linear time invariant plant. 

The problem is formulated as a stochastic problem because the initial 
condition is assumed to be a random vector with known first and second 
.order statistics. - The optimal control sequence is defined as that 
control sequence which minimizes the e5q)ectation with respect to the 
initial conditions of the discrete time standard cost, quadratic in 
the states and control with the inclusion of cross terms. Only the 
problem formulation and results are presented since this problem is 
solved in the literature. 

Optimization Problem Statement 
Given: 

a) the following minimal discrete-time linear time invariant 
plant: 

X(t+1) == A x(t) + B u(t) ; t e [0, 4yo) (2.1) 

where 

x(0) is an valued random vector with known first 


and second order moments 
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x(*) is an. valued random process wiiix statistics 
derived from (2.1) and the initial condition, 
statistics 

uC*) is an valued random process that is a linear 
function of x(*) . 

The known matrices ^^(n x n) and B(n x r) have real entries 
and eire dimensioned accordingly to x(*) and u(*). The 
pair (a,B) is controllable. 

b) the real weighting matrices Q(n x n) r S(n x r) and R(r x r) 

. such that- 

^ 0 and R > 0 (2.2) 

Find; the optimal full-state 'feedback control*, .defined -as 

that control sequence which minimizes the following cost; 

J(u) = E [S 
(t=0 

The solution to the above optimization problem is well known 
IdI] to be 

u(t) == P x(t) = -(R + B^rB)“^(B’rA + S^)x(t) (2.4) 

where V satisfies the discrete time algebraic Riccati equation: 

* More precisely, admissible controls are those which depend on the 
past history of x(»), (") ^ 


(2.3) 


Q S 
S‘ R 
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r = a’T A + Q - (bT a + S') ' (R + BT B)'‘^(BT a + S') (2.5) 

TT ,111 The structure o£ the discrete time minimum order obseyvesr 
based compensator 

In the previous section the probleiti of designing a control 
law (under the assuiaption of perfect full state nieasxarements) for a 
discrete time linear time invariant plant was posed and the solution 
v;as given. In this section the assuitption of perfect measxarements 
is no longer valid and a minimum order observer based conpensator is 
reguired. This section only presents a review of the discrete txme 
minimum order observer. The optimization problem for determining 
the compensator parameters is treated in the next section. 

The assumption of perfect full state measurements in the linear . 
regulator problem (see previous section) is an idealization very 
seldom encountered in applications. Most of the time a linear combina- 
tion of the states is available instead: 

y(t) - C x(t) ; t e [0, +“) (2.6) 

where: 

y(*) is an random process with statistics derived from 
those of x{‘) as given by (2.1). m < n 
C is a real m X n full rank matrix. The pair (A,C) is 
observable. 

In this case, guided by the results in section II.II (that the optimal 
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control law is a linear function of the states) , a reasonable approach 
for solving this problem is to reconstruct or approximate in soma 
sense the state vector. Then the "suboptimal cont 3 X>l” would have the 
same form as the optimal control, but with x(t) (the "approximation" 
to x(t)} instead of x(t) , Of course this is not the only solution to 
this problem; one might also use an optimal output feedback controller 
(Levine [LI]). However, this control might not stabilize the plant, 
or the performance obtained might not be satisfactory for the appli- 
cation at hand. For these or related reasons, the designer may be 
forced to vse a state reconstruotor as part of the compensator. 

In the early sixties, D.G. Luenberger (see tutorial paper [L3]) 
proposed a solution to the above problem; to use what is known as an 
observer. In an observer, all the available information (plant model, 
measurements and external control) is used to reconstruct .asymptoti- 
cally a linear function of the state vector. In the present problem 
observers can be used in different foms. For instance, using what 
is known as an identity observer, the whole state vector is recon- 
structed via a linear time invariant dynamic system of order n. 

Another approach would be to put the plant model in state-output 
canonical form (Luenberger [LSl , Rom and Sarachick [R 3 J.) and rise an 
observer of order (n-m) to reconstruct only the states missing in the 
output vector. The third approach would be to use the observer to 
reconstruct asymptotically the optimal control law u = Px which is 
another linear function of the state (see Portnaim and Williamson 
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[Fl] ) . In tMs last approach there is the possibility of reducing 
the order of the observer to a number less than (n-m) . ^The former 
approach has the disadvantage that the order of the observer may be 
too large for implementation. On the other hand, .the third approach 
presents a series of mathematical complications (see Motazedi IM2]) 
which do not permit the simplicity of the first approaches, iinother 
point is that the multi-output, multi-input case has not been worked 
out. In the following pageis the discussion is centered around the 
second approach: the minimum order observer. 

Given that the whole state vector is not available for imple- 
mentation of the optimal control law a realization of the control 
signals given by the following conpensator is considered: 

z(t+l) = F z(t) + G y(t) + D u(t) {2.7) 

x(t) = N y(t) + M z(t) (2.8) 

u(t) = P x(t) (2.9) 

where: 

z(*) is an random process with statistics derived 

from y(*) 

y(-) is the random process described by (2.6) 

5{*) is an R” random process with statistics derived 
from (2.8) 

The matrices F((n-m x (n-m)) , G((n-m) x m) , D((n-m) x r) , 

N{n X m) , M(n x (n-m)) and P(r x n) are real valued matrices 



- 21 - 


to be designed. 

For the above dynamic system to be an observer (Luenberger 
lL33) the following relation must hold: 

z{t) = T x{t) + e(t) (2.10) 

where z(t) approximates T x(t) if and only if (for the continuous 
time version see Portmann and Williamson [Pl3 ) : 

a) P is an asymptotically stable matrix 

b) TA - FT = GC (2.11) 

c) D = TB (2.12) 

x(t) in (2.8) estimates x(t) if and only if T, in addition to a), b) # 
c) / satisfies the following relation: 

HC + MT = I (2,13) 

As a result the error dynamics described by 

e(ttl) = F e(t) (2.14) 

are guaranteed to decrease asymptotically to zero as time progresses 
(see condition a) above) . 

One useful equation that comes up as a result of using (2.6), 
(2.10) and (2.13) in (2.8) ist 

x(t) = x(t) + M e(t) (2.15) 

The dynamics of the observer as well as the error is determined 
by the eigenvalues of F. This suggests the conclusion that the closer 
the eigenvalues of F are to the origin the batter the observer (since 
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the error approaches zero much faster) . It can he shovm. that very 
small eigenvalues of F do not necessarily minimize the standard 
quadratic cost (see Blanvillan [B23 for a historical account in con- 
tinuous time) • This precaution caused engineers to design dbserveis 
with dynamics a little bit faster than the plant dynamics* T3iis also 
excludes the possibility of having observer and plant with common 
eigenvalues which may preclude the existence of solutions to condition 
b) . The reason for this technicality is the nature of equation (2.11) 
(for a good analysis of this equation see Gantmacher EGll and Luen- 
berger lL3])* 

In the late 60 *s and early 70 's (Newmann iNl] , Yuksel and 
Bongiorno [Yl], Miller [Ml], Rom and Sarachick (R31 and others) 3mich 
interest in obtaining the parameters P,G,D,N#M and T by minimizing a 
cost was e:q>ressed. An approach in the continuous time ease was 
proposed independently by Miller [Ml] amd Blanvillain [B2] (and 
possibly by others) . Miller's approach minimizes the standard quad- 
ratic cost, constraining the control law to be an affine function of 
x(t) . Blanvillain 's derivation transforms the system to the state 
output canonical form, assumes the optimal control to have the same 
form as the optimal control for the linear regulator problem, and 
minimizes the increment in cost due to the use of the observe'r. Miller 
by contrast, proved that the optimal gain on the reconstructed x(t) 
has the same form as in the linear regulator problem. The only slight 
drawback of Miller's analysis is that he does not use the state-output 
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canonxcal transformation to sinjjlify the problem. As a result his 
equations are complicated and sometimes confusing. For the discrete 
time problem .an approach similar to Miller's will be followed, but 
the simplicity ^obtained .when the plant is put in state output canon- 
.ical form 'Will be esgoloited. 

In order to fsimplify (2.1.1),, :(2..:12) and .(2.13) the plant (2.1) , 
(2.6) will be transformed to state-output canonical form*. Then (2.6) 
has the following form: 

yft) " ( 2 . 16 ) 


where I is the m.x m identity matrix and 0 is an m x (n-m) zero matrix. 
The partitioning (2.13) in the same way (2.16) suggests: 



I 


“I 0 - 

0 I 

n X m n X ,(n-m) 


(2.17) 


the I's are identity matrices, in accordance with the partition. Con- 


*This is no loss of generality since, given that C in (2.6) is full 
rank, we can always find a similarity transformation J such that: 

ti : OJ = C 
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siderxng the partitions in (2.17) separately, equations for M and 


H 


are obtained in terms of T and 1 ■ 

1 2 


M = 


0 

1 


„ “1 -1 


Sj = + 


1 

0 


(2.18) 


(2.19) 


“1 


must exist for (2.17) to make sense. Using the above partition 
for T and C, equation (2.11) becomes: 




*1 

1 2 
*2i ^22 




( 2 . 20 ) 


Then, the matrices F and G can be ejq>ressed in terms of T - 

1 2 * 


F = (T^a + )Tj-l = T A I, ® 


G = F^a + - F 

1 1 


-1 


( 2 . 21 ) 

( 2 . 22 ) 


Ii*IV The specific control problem 

As was shovm in the previous section, ail the parameters of the 
compensator (see (2.12), (2.18), (2.19), (2.21) and (2.22)) can be 
determined once the matrix T is known. In this section an optimal 
control problem for determining the matrix T and the feedback gain P 
of (2.9) is posed and solved. The performance index used is the ex- 
pectation with respect to the initial conditions of the standard 
discrete-time quadratic cost. It is shown that the necessary condi- 
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tions to have a stationaary point are satisfied by the feedback gain P 
for the case of perfect measurements. 2lie solution of the optimiza- 
tion problem reduces to finding the solution of two independent dis- 
crete-time algebraic Riccati equations. These are necessary for com- 
puting the feedback gain P and the matrix T independently. The former 
depends only on the weighting matrices and the plant model while the 
latter depends on the initial condition statistics and the plant model. 
As a result we conclude that the control and estimation problems are 
decoupled and a kind of separation theorem holds. The sufficiency 
part of the proof is the subject of the next section. 


Optimization Problem Statement 
Given: 

a) e{x( 0)} = m^ and e{x(0)x’ (0) } = 2 for the process 


x(t+l) = A x(t) + B u(t) 
y(t) = : ol x(t) 


(2.23) 

(2.24) 


b) the matrices A and B for the model (2. 23) -(2. 24) 

c) the weighting matrices Q(n x n) , R(n x n) and S (n x r) 
such that 


Q 

s* 


s 

R 


> 0 and R > 0 


Find; the matrices P(r x n) , T 2 ^({n-m) x m) and T 2 ((n-m) x (n-m) ) 
and the vector ZQ(n-m) such that the functional: 
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J(Pj 


V VV 


. Ox^ + Tils' x^ + x^Su + u*Ru. . 
t t t fc -fc t t -fcl 


subject to: 

x(t-M) = A x(t> t B u(t) 


u(t) = P x(t) + LT 2 e(t) 
e(t+l) = T a L T 2 "^e(t) 


e(0) = Zq - T x(0) 


(2.25) 

C2.26) 

(2.27) 

(2.28) 

(2.29) 


is minimized (Recall that T = ! ^2^^* 

The above optimization problem can be simplified as follows : 
Using (2,28) in (2,25) the cost becomes: 


J(P 


' ^1' ^2' ^0^ ^ I 2) tx^e^l 

(t=0 


Q+SP+P'S'+P’RP 

It I'D I G ^ 


SPhT^^^+P ' KPI.T2''^ 


(T “•^)'L'P'S’ + (T ■"^)'L*P'RP (T “?•) 'L’P'RPLT 
2 2 2 ' 2 




(2.30) 


Constraints (2 

.26) -( 


x(t+l) 

■ 


e (t+1) 



A+BP BPLT 


0 


TALT. 


-n 


-1 


x(t) 

e(t) 


(2.31) 


Using (2.29) the initial state second moment matrix can be obtained: 

2 




x(0) 

e(0) 


x’ 


(0) e(0) 


1 - 


«'Zq“ZT* 


ZQm'-T)^ ZpZ^-ZQm'T'-Tmz^+T Z T' 


(2.32) 
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It is important to note that vising the observer approach the 
closed loop system dynamics (see (2.31)) is composed of two decoupled 
sets of eigenvalues: closed loop system eigenvalues for the perfect 
measurement case plus the error or compensator eigenvalues. Also, we 
should keep in mind that the optimization problem considered makes 
sense only when these sets of eigenvalues can be placed in the left 
half complex plane. Ihis restriction imposes certain properties on 
the system matrices A, B, C that will be discussed later. 

The above dynamic optimization problem can be transformed to a 
static optimization problem of the following form (the steps taken are 
similar to the ones in Appendix D for the output feedback controller) t 




I*! r, 

Xi ^2 

ri V2 


S mz^-ST ' 

* 1 

Tl Tx ’ 

1 ^2 

z_m'-TZ z_z’-z^m’T’-Tmz'+T2T' 

i 


L 0 0 0 0 0 J 

\ 

L ^2 ^2_ 


(A+BP) ' 0 

-1 -1 
(BPLT2 ) ' (TALT2 ) ’ 


J L ^2 


2 J 


(A+BP) (BPLT^"^) 

-1 

0 (TALT 2 ) 


SPLT.“^+P ‘ PPLT.“^ 


Q+SP+P'S'+P'EP 2 

(T2~^) 'L*P'S*+(T2~^) *L'P'PJ> 'L’P'BPLT2~^* 


K, 


1 

L 2 


K, 


K, 


2J, 


(2.33) 
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where K = 


Kj, K 
1 '*•2 

2 "^2 





TO 

t m ^ 

X 


“2 

-J 

i. ^ 


r = 


n 


r r 

1 2 

r» r 

■ 2 2 


2 = 


•^1 ^2 
S« 2 


with dimensions accordingly. 

The necessary conditions for (2.33) to have a stationary point 
at P*, T*, 2;*, 3 *, K*, * are the following: 


8j 

3p 


IJ 

8T, 


= 0 

* 

= 0 


C2.34) 


(2.35) 


3J 

3T„ 


= 0 


(2.36) 


3j 

9z. 


M. 

3K 


= 0 


= 0 


(2.37) 


(2.38) 


3j 

3r 


= 0 


vjhere 


means "evaluated at P*. T*. T*, z* , k* F*'' 

1 2 0 ' 


(2.39) 
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Using Athans IA3] the above conditions becomes 
Prom (2.34) : 

[S’ + BP* + BT* (A + BP*)3K* + [S' + KB* + BT* (A + BP*)J‘ 


. K* 'L’ + [RP* + bT* BP*3LT*“^*’ 4* 

ig 2 2 ±2 

4- [i»* 4* BT* BP*1LGJ*“^* *L' 4- B*r* T*AIiT*~^ 


X£~ ' 2 22 2 

' [K*' 4- K* 'L'3 =0 

^2 


h 2 


(2.40) 


From (2.35) ; 


[- 

1 


y * 

L •’• 2 J 

+ r* 


^2 

L 0 1 

1 1 

M 

• 

0 

(2.36) s 


V 

r*» [- 

^2 

I 2 L 





4- (A 4* BP*)K* (T*”^) •A’^2 BP*LT*”^K* (T*~^) *A^ j 


(2.41) 


+ (A 4- BP*)K* (T* ’a’ 4- BP*LT*“^K* (T* S 'A* ]. 


^ + TJE + T*z + (T*a * 11*^2 ’■I '4 J 

A ^ A ^ 

- T*‘%*'(SP*L + P*'RP*L + (A' 4- P*'B')r* (T*A 4- T*A ) 


4- (A' 4- P*'B')r* BP*L)T* 

h ^ 


'll , _ 
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- '(l,‘P*'SP*L + L'P*'BT* BP*I, + 

+ l'p*'bT* (o?|a^ + t*A 2 ) + (ai t** + a* T|’)r*'BP*L + 


2 1 


4- (a* 5?*' 4- A* T*')r* (T*A, 4- T*a. • =0 (2.42) 

lo 3. 2« 2 2o 1 lo 2 ^ J 


From (2.37) 


r|’m 4- r* (z* - T*m) = 0 
2 ^^2 


(2.43) 


From (2.38): 


r* 

r* 

\ 

1 

r*» 

p* 

- ^2 

2 


(A 4- BP*) (BP*LT* ) 

0 {S*ALT*“^) 


(A 4- BP*) ' 0 

-1 -1 
(BP*LT* ) * (T*ALT* ) ' 


.-1. 




r*« 

. ^2 


"L 




2 J 


SP*LT*“^ 4- P*'EP*LT*~^ 


Q 4- SP* 4- P*'S* 4- P*’EP* 

(T*“^) 'L’P*'S* 4- (T*“^) 'L'P*'RP* (T* ■") ’L‘P*'BP*LT* 

2 2 2 2 


(2.44) 


From (2.39) : 


K* 

K* 

I2 


(A + BP*) 

BP*LT***^ 

2 


K* 

K* 

I2 

L "2 

K* 


0 

T*ALT*“^ 

2 


K** 

L 2 

K* 

"2J 
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(A + BP*) ' 
(BP*LT*“^) • 


2*it,» - ^*2 


(T*A1.T*“^)' 
^ J 


512* » ~ 2T*' 


z*z*' - z*m'T* '-T*inz*' + t*St* 


(2.45) 


The above conditions can be simplied as follows: 

E:qjanding (2.44) the following matrix eguation is obtained: 


r* - (A + BP*) *r* (A + BP*) + Q -t- SP* + P*«S' + P*»RP* 
1 -^1 


(2.46) 


comparing this equation with (2.5) we can see that if P* is given by: 


p* = _(R + bt* B)“^(B'r* A S') 


(2.47) 


Equation (2.5) is obtained with F*^ - F. We will suggest such a solu- 
tion to the necessary conditions. t?hether the results will be suffi- 
cxent for optimality is a question to be answered later. 

Another partition of (2.44) is as follows: 

F* = (A + BP*)'F* (BP*LT*“^) + (A+BP*)'F* (T*ALT*‘'^) -t- 
2 ^ lo 2 


+ SP*LT**"^ + P*'RP*lT*~^ = 0 
2 2 


(2.48) 


Using (2.47) in (2.48) 


r* = ^ BP*>'F* (T*ALT*~^) 

2 2 ^ 


(2.49) 


If the analysis of this problem is done for the finite time i 


time interval 
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[0, T] and then the limit is taken we will find that the bounda:Ky 

condition for (2.49) is T, (T) =0, which implies that 

2 

0 (2.50) 

2 

for all t. 

With r =0 and P given by (2.47) the third matrix equation 
•*•2 

from (2.44) becomes s 


r* = (T*ALT***^) »r* (T*ftLT*"^) + (T* ^) ’ [L*P*'B'r* BP*I, + 
2 ^ ^ ^ ^1 


+ L*P**EP*I.]T* 


-1 


(2.51) 


Studying this equation (see Appendix B) we will find that F* has to 

2 

be positive definite in order that a minimal order observer be 
t&tained. 


that: 


Using the above argument and F* = 0, from (2.43) is obtained 

2 


Zq = Tm 


(2.52) 


since F* ^ exists. Even if one cannot conclude that F*~^ exists, 

^2 22 
(2.52) IS sufficient for (2.43) to hold. As will be shown later this 

condition is sufficient for optimality. 

Using (2.47) and p* =0, (2.40) reduces to: 

•^2 

[BP* + B'F* BP*]LT* ^K*' + [RP* + B’F* BP*]LT*~^* (T*~^) 'L = 0 
ll 2 I2 h 2 Zj 2 ' 


(2.53) 
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and (2.43.) tos 


- 1 . 




• (T§~S’iV,* = 0 

^ ^2 


Equation (2.42) reduces to: 

r* f3P*(23L ^ •*• ^2^^2 " ’®2”^2^ '*' 

2 2 ^ . 

+ (T*A- + T*A., )T*“^K* (T*'“^) 'ai ) 

1 I2 2 2^ 2 ^2 2 ^2 


BP*L + 


- [TS^^K* (T*”^) ’ fl.’P*'HP**L + L*P*’B‘r* E 
2 ^ 2 ' ' 

+ (A’ Tf' t Ai iC**)r* (T*A + T*A ))t*''^3 ' = 0 

i., 1 2o 2 2.5 i. io .i /io / ■* 


(2.54) 


(2.55) 


IJsinq equation :(2,51 ) , (*2,'S5) becomes; 


^ 1 .. 


r * IT |( S ^ - + ‘^^< 2:2 - m2 ^ n2 ^ ^ ^ 2*2 ^“^2 ^ 


(T*"^) 'A* ] - (T*"-^K* r* ) • - 0 
2 ^2 ^ 2 "^2 




2 “ "2 
(2.56) 


Therefore: 


T*(Zl - nij^mp + T|(Zj, - + ,(T|A + t|A >T| K* • 


or: 


(T*~^) 'aA - KS (T* ^) ’ = 0 
^ 2 ^2 


K* = (T*A. + T*A_ )T*"^K* (T*~-^)'A' T*' + T* (2 

2 ^ 1 I 2 2 22 2 22 ^2 ^2 


(2.57) 


I TV • 


- Bijm ’) T |' + 


(2.58) 


2 

If one ea^ands (2.45) in three matrix equations, from one of them it 
can be shown that (2.58) has been satisfied already if (2.54) holds. 
That is, from (2.45) 

Z*z*' - z*m'T*' - T*mz*' + T*XT*' + (T*2U!.T*‘'^) K* (T*M.T*“^) ' 

O 0 0 0 ' ^ *2 ^ 


= K 


(2.59) 


Using (2-52), (2.59) becomes: 


[TJdj, - - m^m') + (T*A + - 

X 2 2 2 

- T*“^* (T?-^) 'A' ]T* + T*(Z -> in,m‘)T*' + 

2 2^ 2 X^ X X X^ . 


- (T*"*^) »?.' T** = 0 
2 22 2 


(2.60) 


It is clear that given that (2.54) and (2,60) are satisfied, (2.58) is 

satisfied already. This suggests that the optimal cost as well as the 

optimal compensator structure are invariant with respect to the matrix 

T t. A formal proof of this statement would require a similarity 
2 

trans f O 3 nnation on the compensator to show that the optimal cost as well 
as the optimal compensator structure are invariant under such transfor- 
mation. For instance, a similarity transformation T 2 ^ would make T to 


Remark : The solution T* , zg is nonunique to the extent that any 
choice of T 2 (full rank) gives a corresponding T*. 
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be of the form: ® 

® " [^1 : ^] C 2 . 61 ) 

In the continuous time version of the above problem an identical 
sitmtion to the one es^lained above occurs. For instance, in the 
thesis of Blanvillain, T was assumed identity while in Miller’s it 

A 

is arbitrary. 

i^stuning to be the identity matrix the eqviations to be solved 
in order to obtain the optimal discrete time observer based compensa- 
tor are: 

Feedback gain: 


P* - -(R t B'r* A -i- S') 

■^1 •^l 


( 2 . 62 ) 


where: 


r* = A«r* A + Q - (B’r* a + s») ■ (r + bt* B)“'-^(B»r* a ^ sn 

Xi 

( 2 . 63 ) 


For parameters of the compensator: 


T* = 
1 






( 2 . 64 ) 


where : 


K* = + \ - - 

2 2 2 2 2 


- (S’ - m m| -f A K* A’ ) (E - mm’ + A, K* A’ ) “^ . 

X2 ^ X ^2 ^2 ^2 ^ ^ ^2 ^2 ^2 


• (2- - m,ra’ + A. K& kK ) 

^2 ^ 2 2 ^2 ^2 


( 2 . 65 ) 
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Before proceeding with the next section some discussion on the exis- 
tence of the inverses (R + bT* and (Z - m m' + A K* A' 

• 1 X 1 Ig 22 I 2 

is necessary. To guarantee their existence, the matrices R and 

should be constrained to be positive definite. This is 
because, given that the added terms are quadratic and the matrices 

^ 22 ' least positive semidefinite, then the resulting matrix 

sums are invertible. 

It is also important to point out the separation property im- 
plicit in the above equations. Notice that the optimal control law 
gain P* given by (2.62) -<2.63) depends only on the plant model and 
weighting matrices while the observer parameters (see (2.64) -(2. 65) ) 
depend only on the plant model and initial condition statistics. As 
a consequence the control and estimation parts of the problem are 
completely decoi:pled and can be solved independently. 

Sufficiency part of the proof of optimality 
As pointed out in section II. IV, the equation (2.47) was 
assumed of special form and then the consequences were examined. T)iis 
va3ue of P* was proposed because of the known similarity of equation 
(2.46) with equation (2.5) for the case of perfect measurements, in 
other words, the solution (2.62- (2.65) satisfies the necessary condi- 
tions, but these may not be sufficient for the minimization of (2.33). 
The original approach proposed to answer this question is due to 
R.A, Miller for the continuous time version (Ml). The discrete time 
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version miniics such results, so they are not repeated here. Instead 
the following paragraph outlines the most important issues of the 
proof. 

In order to prove the sufficiency paart. Miller [M2] expressed 
the cost functional (2.3) as a linear combination of the optimal 
cost for the linear regulator problem with perfect measurements plus 
an increment in cost due to the use of a control different from it. 
This is done using a least squares approach analogous to Brockett's 
lB4] . Then by means of a similarity transformation the deterministic 
and stochastic aspects of the control problem may be separately exam- 
ined. In this way it is shown that the increment in cost consists 
of two parts: one dependent on u{t) and another completely independent 
of u(t) . Also a set of constraints on u(t) are obtained. Since the 
second term of the increment in cost is independent of the optimal 
control law, only the first tern is considered in the minimization. 
Thus, an expression for u(t) which minimizes this term to zero is 
obtained. Recall that this u(t) is subject to a set of constraints. 
Ihen, what is left to prove is that the observer-based control law 
proposed in section II. IV realizes this optimal control law and 
satisfies the constraints. 

II. VI Conditions for the existence of positive definite and positive 

semidefinite solutions of the Riccati equations (2.63) , (2.65) 


Traditionally, the problem in modern control theory that has 
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been solved and studied first has been the linear regulator problem 
with no cross term in tlie cost. In part this has been so because the 
linear regulator problem with a cross term in the cost can be refor- 
mulated as a linear regulator problem with no cross term and because 
in this format the problem is sinpler to solve. For instance the 
necessary conditions for existence of positive definite and positive 
semidefinite solutions of algebraic discrete time Riccati equations 
in Appendix A are for linear regulator problems with no cross term 

in the cost. 

In order to show that the equations (2.64) -(2. 65) can be under- 
stood as an optimal feedback gain for a discrete time linear regulator 
problem with a cross term in the cost they are written as follows: 

= -(Si - - m'm^ + A^^K*^A^^) 

( 2 . 66 ) 


where : 


K* 

2 , 


K* a; + S - mm* - (2*^ - m2m^ 
2 a ^2 22 22 ^ ^ ^2 


(S - m m* + A K* A* ) ^(2 - mj^m* + Aj^ K* Aj ) 

11 ^2 '^2 "^2 "^2 2 2 2 


• + A, K* A' ) 
2 ^2 2 


(2,67) 


Comparing these with (2.62) and (2.63) the following equivalence is 
obtained ; 





( 2 . 68 ) 


(2.69)- 


B ~A* 

r ~ K* 
^2 



S 



m ra* 


2 1 


Q ~ Z — m III’ 
2 „ 2 2 
jL 

p* ^ q;*» 

i 


(2.70) 

(2.71) 

(2.72) 

(2.73) 

(2.74) 


where ~ means "equivalent to", ahen using the following matrix 
identity reported by Sain [SI] the problem with a cross term in the 
cost can be formulated as one with no cross term iii the costs 

AB)“^ = ^n " BA)“^B (2,75) 

where s 

: n X n identity matrix 
A : n X r matrix 
B I r X n matrix 

the following results are obtained: 


Q = Q - Sr“^s' (2.76) 

— -1 

u(t) = u(t) + R S'x(t) (2.77) 

A = A ~ BR ^S’ (2.78) 

B = B (2.79) 

R = H (2.80) 
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where the matrices Q, A and so forth are the appropriate matrices for 
the discrete time linear regulator problem with no cross term (the 
formulation of this problem as well as the optimal control law can be 
obtained making S = 0 in the material presented in section 11,11), 

Now the results in Appendix A can be applied. These conditions 
require among other things that for positive definiteness of T* and 
K*: ^ 

a) (A - BR S', B) be a controllable pair, 

1 

b) (A - BR , (Q - SR ' ) ^) be an observable pair 

and 

~ ^ A' ■) be a controllable 

^2 J-2 li 11 I 2 12 I 2 

pair, 

■'’ VP- 

1 

(E - - (E- - (E - (E^^ - 

^ 1 2 

be an observable pair 

respectively. The controllable conditions a) and c) are satisfied if 
the following conditions (see Gopinath [G2]) ; 


and 


e) (A, B) be a controllable pair 


f) (A 2 , A- ) be an observable pair 
2 2 


are satisfied respectively. The f) condition is satisfied if the 
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pai.r (A, C)* is observable (see Gopinafch [G2]). 

II .VI Other issues related -bo this problem arid cbnanents on tbe 

» 

literature 

As pointed out in section II .III, considerable sinplicity is 
gained in section II. IV if the pleait is initially transformed to a 
state-output canonical form. It happens that the transformation used 
to obtain such a canonical form is not unique although the plant 
dynamics are conserved. It can be shown that any two such realiza- 
tions of a plant yield the same compensator dynamics (eigenvalue 
structure) and even more, any two realizations of the optimal compen- 
sator yield the same performance. For continuous systems this is the 
subject of a paper by P. Blanvillain and T.L. Johnson [33], In the 
discrete time domain the analysis is quite similar (see Appendisc C) . 

Recently it was discovered that the necessary conditions 
obtained in section II. IV were reported independently by G. Roberts 
iRl) and J. O'Reilly-M.M. Newmann [01], The approach followed by 
Roberts mimics the approach taken by Blanvillain [B2] . He only 
reports the necessary conditions. O’Reilly and Newmann, on the other 
hand, take the same approach of section II. IV but assuming T =-I. 
They also prove in detail the sufficiency of the above solution and 
present sufficient conditions for the existence of positive definite 


* Recall that the triple A,B,C was transformed to state-output canoni- 
cal form and therefore C has the form [I : 0] . 
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and positive seinidefinite solutions of the resulting Riccati 
equations. 


Chapter III 


THE DISCRETE OPTIMAL OUTPUT FEEDBACK CONTROLLER 
III. I Introduction 

One way of posing (via augmented matrices) the problem of reg- 
ulating a linear time invariant plant with a linear compensator of 
limited dimension is to use the format established by Levine [LI] for 
the output feedback controller problem. This approach was taken by 
Johnson and Athans [Jl] in 1970. Later in 1975, Sirisena and Choi [S2] 
presented a "new way" of defining the performance cost.* As will be 
discussed below, the only difference between these two approaches is 
the way the performance criterion is structured. 

This chapter is structured as follows. In section III. II the 
discrete time versions of the optimal constrained dynamic compensator 
problem by JohnsOn-Athans and Sirisena-Choi are presented and briefly 
compared. Later in that section the differences betaraen these 
®PP^o3ches and the one suggested by Luenberger observer theoi^ [L31 
are pointed out. Section III. Ill deals with the formulation of the 
optimal constrained dynamic compensator problem as an optimal output 
feedback controller problem. In the fourth section the optimal output 


*The performance cost of the system composed of the plant and com- 
pensator. 
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feedback controller problem is solved by posing- the problem as a 

static optimization problem. In section III.V a "Direct Approach" 
is presented. 

Optimal Constrained Dynamic Compensator (Discrete Time) 

The problem studied by Johnson and Athens in 1970 came up as 
a result of studying the regulation of a high order deterministic 
system with a small number of outputs. This problem can be attacked 
iising an optimal compensator which incorporates a minimum order obser- 
ver, but the order (n-m)* of this compensator may still be too high 
for implementation. One possible approach to this problem would be 
to mimic Miller's [Ml] results for an observer , of dimension less than 
(n-m) , but this is not possible due to the fact that a crucial rank 
condition'^ is not satisfied. Johnson and Athans proposed a formulation 
in which the dynamic part of the conpensator is not constrained to be 
an observer of the plant state vector. This Mulation in discrete 
time yields the following results i 

Consider the linear time invariant plant; 
x(t+l) = A x(t) + B u(t) ; E{x{0)} = m^, t e [0, 
vrLth output equation; 
y(t) = c x(t) 


_ ‘^**'snsion of the plant state vector space 
- dimension of the output vector space 

"^See equation (2.12) in Miller's [Ml]. 


(3.2) 
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where ; 

x(*) is an R^- valued random process v?ith known first and 
second order statistics.* 

uC*) is a linear function of x(*) generated by (3,3) and 
(3.4). 

y{*) is an R”*-valued random process with statistics derived 
from x{ •) . 

The matrices A, B, C have real valued entries and dimensions accord- 
ingly. 

The compensator dynamics are represented by the following linear 
time-invariant system: 

z(t+l) = P z(t) + G y(t) (3.3) 

with output eguation (control law for the plant) : 

u(t) = M z(t) + N y(t) (3.4) 

where; 

z(t) e R® ¥• t E i0/+») 

and the matrices P, G, M, N have real valued entries and dimensions 
accordingly to z(*), y{*) and u(*). 

Given the form of the cempenaator, the choice -of tperfiormance 
index for this design problem is crucial for obtaining a well posed 


*We will assume that x(0) is vector valued random variable with kno\«i 
mean and covariance and therefore (3.1) is a representation of a 
Markov process and it’s first and second order statistics can be 
computed recursively. 


-46- 


prpblem as will be indicated later. 

Optimization Problem Statement 1 (see Appendix B) : 

Given; a) e{x( 0)} and cov(x{0)) for the process in (3.1) 

b) the matrices A, C for the model (3.1)-(3.2) 

Q S ^ 


c) the weighting matrices 
for i = 1,2 




> 0, R. >0 

— X 


Find; The matrices with real entries: F(sxs), G(sxm), 
M(rxs) and N(rxm) . 
such that the functional: 


'Su t 
t 


J(G,N,F,M) = y) x'QX + u‘S'x^ + x'S 
lt=6 ^ ^ t t t 

+ y' [G’R^G + N'R,N]y + z’ EF'R^F + M'R,M)z^l (3.5) 
t 2 ltt2 It) 


with constraints: 

x(t+l) = A x(t) + B u(t) 
y(t) = C x(t) 
z(t+l) = F z(t) + G y(t) 
u(t) = M. z(t) + N y(t) 

is minimized. 


(3.6) 

(3-7) 

(3.8) 

(3.9) 


Notice the presence of the terms y^G'R Gy , z'F'R Fz and 

^ 2 1 ^ t 2 w 

z'M'R Mz. in the cost functional (3.5). In the usual formulation of 
t It 

the time-invariant Linear Plant Quadratic Cost regulator problem [a 4] 
these terms are not included. However for the problem formulated 
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above, with the absence of these terms, the corresponding solution 
becomes a trivial one. That is, since no constraints are imposed on 
P, G and N then these matrices in the closed loop plant-compensator 
system will tend to aero in order to minimize the cost functional, 
iinother reason for selecting the cost functional structure as in (3.5) 
is that this problem, when reformulated, is equivalent to the output 
feedback controller problem [L2J. 

The choice of the weighting matrices in (3.5) is not a trivial 
task, as usual the matrices Q and S can be chosen based on the 
physical limitations on the plant state and control vectors. On the 
other hand, the matrices and can be chosen based on the limita- 
tions of the physical elements responsible for producing the gains M-M 
end G-F respectively. E^ is the same for Hy^ and because we are 

assuming that the same kind of physical elements are used for the 
gains N and M. 

One slight drawback of the above formulation is <-'-.at the control 
law obtained is more difficult to compute than in Sirisena and Choi’s 
approach [S2I. The only difference in formulation between these two 
approaches is the structure of the cost functional. The discrete-time 
version of Sirisena and Choi’s approach is presented next. 

Optimization Problem Statement II : 

Gxvenj (a) e{x( 0)} and cov(x(0)) for the process in (3.1) 

(b) the matrices A, B, 


C for the model (3.1) -(3.2) 



1 — 

! 
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(c) the weighting matrices 
Qg ^ 0/ > 0 for i = 1,2 


Q, 


S’ R, 


> 


Finds the real valued matrices F(sxs), G(sxm) , M(rxs) and 
N{rxm) 

such thati the cost functional 


J(G,H,P,M) = E-(5Z + x'Su^ t z’Q^S t V?R V 

tit t t t t t“2 t t 2 t 


u'R u V 

tit/ 


(3.10) 


subject to: 


V<t) = F z(t) + G y{t) 


(3.11) 


and {3.6)— (3.9) is minimized. 

In this formulation it is easier to determine the appropriate 
weighting matrices. As usual the matrices Q^, S and Rj^ can be chosen 
based on standard considerations (see Bryson and Ho [b 5]). R^ is chosen 
chosen as to limit the input to the time delay element (see Fig. 3.1) 
in the compensator dynamics. The only problem with the above cost 
functional is that the state of the compensator dynamics is also being 
penalized. There is no physical reason for weighting this term since 
we are not interested in minimizing the deviations of z(t) from zero. 

In the two formulations described above, no specific constrain- 
ing relation among the plant and compensator states is established- 
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This fact constitutes the crucial difference between these design 
criteria and the one based on the theory of minimal Luenberger obser- 
vers [B2;M13. However, it should be noted that any system (3.6) may 
be interpreted as an observer [R2] . Iflhen an observer is used as the 
dynamic part of the compensator a linear relation between the observer 
and plant state is implicitly assumed. Using observer theory one of 
the design objectives is to reconstruct asymptotically a linear com- 
bination of the plant states. 

III. Ill Formulati on of the optimal constrained dynamic compensator 

controller pro blem as an optimal output feedback controller 
problem 

In this section the central problem analyzed in this chapter 
is posed and then a discussion of how to formulate this problem as an 
optimal output feedback controller problem is given. 

Consider the optimization problem statement II. This problem 
can be suitably modified as to correspond to an output feedback con- 
troller design problem as follov/s: 

(a) Note that the dynamics of the closed loop system (using 
(3. 6) -(3. 9)) is given by: 


~x(t+l)“ 


"A + BNC 

bm' 

■x(t)' 

_z(t+l)_ 


GC 

F 

,z(t)_ 


(b) Using (3.6)-(3.9) and (3.12) in (3.10) and after some 
algebraic manipulation the cost functional becomes: 


“SO- 


J(G,N,P,M) 


E 

[x'z. 3 

Q,+G'N*R,NC+C'N’S*+SNC+C'G'R GC 

XX 2 

t=0 

t t 

M'R,NC + M'S' + P«R GC 

L 1 2 


C ' N * R^M+SM+C ' G * R^F 
Q2 -J- M'R^l-1 + F*R^P 



(3.13) 


(c) Let: 



0 0 


(3.14) 


(d) Then (3.12) becomes: 


x(t+l) 

= A + b‘ P C 

x(t) 

z (t+1) 

L J 

z(t) 

— . 




(3.15) 


and (3.13), 
J(P) 


E I 2 [x'zM (Q + S P C + C'P‘S’ + C’P'R 
t«0 ^ ^ 




P C] 


(3.16) 


Remark: The optimization problem: 


min J (P) 
P 


(3.17) 
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such that 

(3.18) 

is in the format of the optimal output feedback control problem for 
which a solution is given in Section III. IV. 

A refijiement to the optijnization problem II is obtained by 
replacing the constraint (3.11) by the following: 

V(t) = P 2 (t) V G y(t) - z(t) (3.19) 

5iiis cost component (see (3.10;) constrains the "size" of the jumps 
allowed to the compensator state in successive time intervals which is 
usually a physically desired condition. However, a heavily penalized 
compensator state difference v(t) decreases the speed of response 
(to perturbations in the nominal plant state) of the compensator. 

Thus the choice of should be made taking in consideration this 
tradeoff. 

With the modification suggested above the corresponding formu- 
lation of the optimal output feedback controller problem develops as 
follows : 

(a) From (3.19); 

V(t) = (F-I)z(t) + G y(t) (3.20) 

(b) let : 

F = F - I (3.21) 

(c) Then the closed loop system equation becoru’s ; 


x(t+l) 

= A + B P c 

X(t) 

z (t+1) 

L J 

z(t) 
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x(t+l) 


s(t+l) 



A + BNC BM 
GC F + I 


x(t) 

z(t> 


(3.22) 


(d) After some matrix manipulations (3.10) becomes. 


J(G,N,F,M) = E { 2 [X' * 

't=0 


Q^+C • N » Rj^NC+C ' N ’ S ' +SNC+C ' G ' RgGC C ' N * Rj^I4+SM+C * G ’ R 2 F 

M • Rj^NC+M" S ' +F ’ R2GC ' ^2^ 


(3.23) 


Note that if matrices P and A defined as 

r« 


M 

p” 


A = 


A 0 

0 I 


(3.24) 


and B, C, R, Q, S are as in (3.14) then the formulation of the optimal 
output feedback controller design corresponding to this case is iden- 
tical to the one given before. 


III. XV A Solution of the Discrete Optimal Output feedback controller 
problem via Lagrange Multipliers 

In this section a procedure for solving the optimization problem 
(3.17) -(3.18) is discussed. 

Recall that the problem to be solved has the following form: 


Given: (a) e{x( 0)} and cov(x(0)) 





(b) the weighting matrices: 




> 0 , 


R > 0 


Cc) the system matrices: 

A{(n+s)x(n+s)) , B((n+s)x(s+r)) 

CC (s+m) x(n+s) ) 


Minimize with respect to P ( (r+s) x(s+m) ) the foliowing cost fimctional: 


J(P) = E I ]C [X^ [Q + S P C + C'P'S' + C'P'R P C] 
1 1=0 


[Si 


( 3 . 25 ) 


subject to: 


Lz(t+i)J L -iLzctjJ 


( 3 , 26 ) 


It is easy to ^ow that this problem can be solved by solving the 
follovring equivalent problem; 

Given (a), (b) , (c) as above, minimize the following cost 
functional: 


jr(P) = E 


' t=0 


x'Ox + x'Su + 
t'^ t t t 


u 


+ u'Ru 
t t t 


( 3 . 27 ) 


subject to: 

x(t+l) = A x(t) + B u(t) 


( 3 . 28 ) 
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uhere : 


y(t) = C x{t) 
u(t) = P y(t) 

x(t) corresponds to 


(3.29) 

(3.30) 


■K(t}' 


and the matrices Q, s, R, A, B, C, P 


Lz(t)J 

have the same properties and dimensions as before. Notice 

~cov(x(0)) 0 


E{5(0)} = 


E{x(0)} 

L z(t) . 


and cov{x(0)} = 


0 J 


The above dynamic optimization problem can be posed as the 
following static optimization problem (for details see Appendix D) : 

Giveni (a) E{x(0)x* (0) } = 5^ 

(b) the matrices with real entries: 

A( {n+s)x(n+s>) , B( (n+s)x(s+r) ) , C{ (s+m)x(n+s) ) 

Q( (n+s)x(n+s)) , S( (n+s)x(s+r) ) , R((s+r)x(s+r) ) 

with the properties as before. 

Minimize : 

J(r, P) = tr {r Xq} (3.3X) 

svibject to: 

r=Q + S*PC + C'P'?* + C'P'R P C + 

(A + B P C) T(A + B P C) (3.32) 

The optimization problem (3. 31) -(3. 32) can be solved by a standard 
Lagrange Multiplier technique: 


Let; 



The necessary conditions for (3.33) to have a stationary point at 
r*, V* r 2* are; 


3J 

3r 


= 0 


(3.34) 


3P 

3j 

3S 


= 0 


= 0 


(3.35) 


(3.36) 


means "evaluated at T*, p* , E*". From (3.34) it follows that 


E* = (a + B p*c) E* (A + B p*c) ’ + Xp 


(3.37) 


From (3,35) : 

i’'E*C’ + R P*C E*C* + "bT*^ E*^' + B*r*B’ P*C Z*C' ~ 0 ( 3 . 38 ) 


(3.36) gives (3.32) with F = F* and P = P*. 

Solving simultaneously algebraic equations (3.37), (3.38) and 
(3.32) with F = F* and P = P* we obtain F*, P*, E*. 


If 


3^J 

3a 


> 0 for a = F, P, 


'a* 


minimum. This condition is not easy 


E then the above solution is a 
to test due to the fact that it 


is a tensor. 



XII.V A solution to the discrete optimal onl -pnt feedback controllejr 

problem by a calculus of variati on method 

I„ section III. IV e solction »as given for the discrete optical 
output feedbuok ooutroller problem equivelent to the reduced eotpen- 
sator scheme described in III. III. m this section an alternate 
procedure for solving this problem is given. The basic difference 
between this techuigue and the one given in IH.IV in that in the 
latter a two step parameter optimisation procedure was followed in 
order to determine the unkno-..-n parameters of the compensator (the 
matrir P) while in this section a direct optimisation procedure is 


followed. 

The 1 :e< 2 hnique to be presented is very sxmlar to the one used 
by Levine. [L2] when he solved the output feedback controller problem, 
it is presented for the sake of giving more insight to the jproblem 
and as a way of presenting several tools which are useful when solving 
discrete time optimization problems. It uses the discrete time 
version of Bellman’s result on perturbation theory [Bl, P- 174] and 
Kleinman's results [K4] for finding gradient matrices. These are 
presented in Appendix E for the sake of completeness. 

The approach \ised here is termed a direct method because the 
closed loop system equation (obtained combining ( 3 . 28 ) -(3. 30) ) is used 
directly in the cost. Then, given that the cost is only a function 
of the unknov/n matrix P, we proceed to find the necessary condition 

of a stationary point obtaining: 


for the existence 
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(3.39) 


In order to obtain this condition Kleinman's lemma [K4] is used. It 
reads as follows: 



(3.40) 


where £ is a perturbation parameter and AP a perturbation matrix. 

This is where the result by Bellman on perturbation theory for 

(a + I'pc + ebApc)^ 

is used. 

Ihe necessary condition obtained is the following (for details 


see Appendix E) ; 


3p 


- t-1 ( _ X- - - - t 

= 2 X) S ]C(A + B P*C) Xq(A' + C'P*’B*) 

t=l T=0 I 


_ t“(T+l) — 

g + c ' P* ’ R P*c + S P*C + C ' P* ' S ' 3 (A + B P*C) B 


• [Q 


+ X) ]^(A + B P*C)^X (A'+ C'P*'B')^(C'P*R + s) 

t=0 I 


(3.41) 


In order to compare (3.41) with the necessary conditions obtained for 
the equivalent problem in section III. IV, equations (3.32), (3-37) and 
(3.38) are written in compact form: 
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Por (3.32): 

CO 

r* = ^ (a' -f- c'p*’B^’) [^ + s' v*c + c*p**s’* + c’p*'r p* c 3 • 

t=0 

” (a -i-BP* C3*^ (3.42) 

For (3.373 = 

CO 

S* = 2 (A + B P*C) (A* +C'P*'B')^ (3.-13) 

t“0 ° 

It can be seen that (3.43) is identical to the second term in the 
L.H.S. of (3.41). The first term in the L.H.S. of (3.41) is, if 
we ej<pand all the involved terms and use (3.42)-(3.43) , Identical to: 

C Z*(C‘P* B* + A')r**B 

After adding the above term to (3.43) v/e obtain (3.38) . 

Therefore it bas been ^proven ■that the set of sguations (3.,32) , 
(3.37) and (3.38) are e(juivaa.ent to the (compact -equation '(3.-4i), 



CHAPTER IV 


REDUCED ORDER TIME INVARIANT COMPENSATOR DESIGN 
IN THE CONTEXT OP AGGREGATION THEORY 

IV.I Introduction 

In the last chapter a method for designing suboptimal reduced 
order linear time invariant compensators was given. The design method 
consisted of assuming linear reduced order dynamics for the compensator 
and determining its parameters so as to minimize a quadratic design 
criterion. In this chapter the optimal reduced order compensator 
problem is tackled in the context of aggregation theory . The chapter 
is inspired by M. Aoki's paper "Control of Large Scale Dynamic Systems 
by Aggregation" [All . 

For notational convenience, all the analysis will be done in 
continuoiis time. Although there are important technical differences 
between discrete and continuous time systems, the techniques developed 
in t)- is chapter can be easily translated to corresponding techniques 
for discrete time systems. 

This chapter is divided into four sections. In the second sec- 
tion the heart of the design philosophy named "aggregation theory" is 
briefly reviewed. Section IV. Ill presents a solution to the optimal 
output feedback control problem via aggregation theory- The subject 
of the fourth section is limited dimension control (using suboptimal 
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observers) via the aggregated model. 

IV. II Review o£ Aggregation Theory for Linear Systems 

It has become an almost standard step in systems oriented 
engineering analysis and/or design to develop a mathematical repre- 
sentation (called "a model") of the dynamics of the system. Models 
may assume many different forms, e.g. , time domain or frequency 
domain- For instance, in applying modern control methods, it is 
often advantageous to use a set of first order linear differential 
equations (see Kalman IK2]) as a model. In obtaining the parameters 
of such differential equations a coitpromise between simplicity and 
accuracy must be made- Sometimes certain inherent physical properties 
of the system must be ignored and a reduced model is sought. The 
topic of interest in this section is one class of linear reduced 
order models called "aggregated models". 



MODEL 


Figure 4.1 
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The main idea of aggregation tlieory, in the context of linear 
dynamical systems, is to obtain a model of state space dimension less 
than the dimension of the "true model" (see Fig. 4.1) . The state of 
this "aggregated" model is to be linearly related to the state of the 
true model. The aggregate model must reflect the most significant 
portion of the dynamics of the true system. 

Consider the plant described by the true model given by: 


x(t) = A x(t) + B u(t) ? t fi [0, +“) (4.1) 

where : 

x(*) is an J?^-valued random process v;ith statistics computed 
using (4.1) given E{x(0)} and E{x(0) x' (0) } 
u(*) is a linear function of x(*) contained in 

and the reduced order model given by: 

z(t) = F z(t) + D u(t) ; t e [0, + 00 ) (4.2) 


where 


2 (‘) 

u(-) 


is an R^-valued random process v/ith statistics computed 
using (4.2) and the knowns e{z( 0)} and e{z ( 0) z' (0) }; p < n 


is a linear function of z C • ) 


contained in R 


r 


t 


The matrices A, B, F, and D have real entries and are dimensioned 
accordingly v;ith z(-), x(-) and u(-). Assume (A,B) and (F,D) be 


'^Recall that the control vectors in the reduced and true models are 
in the same vector space. 
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controllable pairs. 

Following Aoki lAl] , a linear reduced order model C4.2) for 
a given linear true ntode3 (4.1) is called an aggregated model if 
there exists a full rank matrix H(p x n) such that the true state 
x.(*) and the aggregated state x(*) are related by; 

z(t) = H x(t) (4.3) 

OJhus,, the following conditions hold; 

FH = HA (4.4) 

D = HB (4,5) 

where A(n x n) and F (p x p) are the system matrices for the true model 
and aggregated model respectively. B(n x r) is the control matrix 
for the true model and D(p x r) is the resulting aggregated control 
matrix. See (4.1) and ;(4,.;2) . The matrix vH(p x ;n) is idle .so-called 
aggregation matrix because, given the relative dimensions of x(-) and 
z(*)r the vector z(*) aggregates the properties of an n-dimensional 
system in a p-dimensional space. 

Given the matrix F, a nontrivial solution H for (4.4) exists 
only if the matrices F and A have eigenvalues in common (Gantmacher 
[Gl, p. 215-220]). Intuitive]!^ this result suggests that if F and A 
have the same dominant eigenvalues then the true and aggregated 
models represent similar dynamics. For a method for obtaining H see 
Appendix G. 

Given that H is known and H and A satisfy the matrix equation: 
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H A = H A H' (H (4.6) 

then P is given by: 

F = H A H* (H (4.7) 

Remark: In both cases, whether H or F is known, equations (4.4) and 

(4.5) have to be satisfied exactly in order for (4.2) to be called cin 
aggregated model. 

The initial condition statistics for the aggregated model can be com- 
puted from the initial condition statistics of the true model as 
follows s 

E{z(0)} = He{x(0)} (4.8) 

E{z(0)z*(0)} = H e{k(0)x* (0) }h' (4.9) 

The notion of “the most significant portion of the dynamics of 
the true model" (see introduction to this section) is left to the 
engineer* s judgement. However, three properties which must be con- 
sidered are: 

i) all eigenvalues with positive real parts must be included 
in the aggregated model 

xi) the dominant eigenvalues (very close to the imaginary 
axis) must be strongly considered for the aggregated 
model 

iii) a "good" representation of the v;eak eigenvalues* may 


*The initial condition distribution may be such that the behaviour of 
the plant is strongly influenced by the v/eak eigenvalues. 
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also be included in the aggregated model. 

A possible approach for considering these three factors is to 
study the relative position of the true eigenvalues* and to make an 
educated judgement (i.e., based on simulations and/or es^erience) to 
allocate the position of the eigenvalues of the aggregated model 
accordingly . 

IV. Ill Suboptimal output feedback control via the aggregation method 
In this section, the problem of controlling a plarit with a 
linear combination of the available measurements is studied from the 
aggregation theory point of view. First, the problem is posed and 
solved as suggested by aggregation theory (see previous section) . 
Then, the method is compared with the one developed by Levine [Ll] 
when a suboptimal control, similar to the one proposed by aggregation 
theory, is used. The main advantages of the aggregation method over 
the one proposed by Levine are its computational sinplicity and 
independence of initial condition statistics. 

One way of posing the limited dimension compensator problem is 
augmenting the state and compensator dynamics in such a way that the 
results of the problem considered in this section can be used, e.g. 
as in Johnson and Athans [jll or Sirisena and Choi [S2 , p. 662-663]. 

*There exists software that computes the eigenvalues according to 
magnitude starting vrith the largest one. Such programs may prove 
to be useful in determining the most significant part of the true 
model dynamics without having to compute all the eigenvalues of the 
system. 
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Suppose that the linear regulator problem (Athana and Palh 
[A4]) has been posed for the true model. That is, for the standard 
quadratic cost, the true state and control weighting matrices are 
known (the time interval of interest is [0, +<“) ) . Assume that a 
control law constrciined to be a linear function of the output vector 
is to be useu. Then, the approach suggested by aggregation theory 
would be to find an aggregated model with state vector equal to the 
output vector of the time model. Suppose the original quadratic cost 
is modified to weight the aggregated state and the linear regulator 
problem for the aggregated model is solved. The suboptimal output 
feedback control is then taken to be the suboptimal aggregated state 
feedback control. 

In mathematical terms the method suggested above requires; 

i) the output vector and the aggregated state vector are the 
same: 

z(t) = H(t)x(t) = y(t) = C(t)x(t) (4.10) 

where y(t) is a p-dimensional output vector of the plant 
described by (4.1). 

ii) After obtaining the aggregated model (see section IV .II) 

z(t) = P z(t) + D u(t) (4.11) 

we have to modify the quadratic cost given for the true model 
as follows (using the Penrose inverse, e.g. see Aoki [a2]): 
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JCu) = E I {z'Q z + u'R u}dt (4.12) 

*^0 

where: 

Q = (H Q H' (H H')~^ (4.13) 

and R/Q are known from the linear regulator problem for 
the true model. 

iii) It is well known [A4,K6] that the optimal steady state feedback 
control for (4.12), (4.11) is given by: 

u = -R~^dT z (4.14) 

where F(p x p) is the solution of the following algebraic 
Riccati equation: 

ft + r F -r D r"^dT + Q == 0 (4.15) 

Sufficient conditions for the existence of positive definite 
and semidefinite solutions to (4.15) are given in Kucera [k5] . 

In order to compare these results v;ith the ones proposed by 
Levine [l 2# p. 787-788], premultiplication by H' and postmultiplica- 
tion by H of (4.15) is very convenient: 

H*F' Th + H' rPH-H' Fd R~^DT H + H*Q H = 0 (4.16) 

Notice that if (4.15) is satisfied then (4.16) is satisfied, but the 
converse is not necessarily true. Using (4.4) and (4.5), (4.16) 
is siroplifiedi 



“67- 


A* {H*r H) + (HT H)A - 


CHT H)BR CHT H) 


+ H'Q H = 0 


(4.17) 


and the optimal feedback control: 

u = -R~^B'(H’r H)x (4.13) 

In order to compare the above results with the equations of 
the optimal output feedback controller obtained by Levine, his results 
are repeated here*: 


Optimal output feedback control: 

u(t) = P H x(t) (4.19) 

where : 

P = S h’ (H 2 H')”^ (4.20) 

and K,E satisfy the following two equations: 

Riccati equation: K(A + B P H) + (A' + H'P'B')K + Q + H’P’R P H = 0 

(4.21) 

Liapunov equation: S (A* + H'P'B’) + (A + B P H) Z + *= 0 

where = e{x(0) x* (0) } . (4.22) 

Let: 

K = HT H (4.23) 

be a solution"^ of (4.21), then (4.19-4.21)** become: 


*The notation has been changed to facilitate the comparison. 

'^’This is a sxoboptimal control in the sense that the optimal K may be of 
rank greater than the number of outputs while this K is of rank equal 
to the number of outputs. 

**Note; Given that the coupling between (4.22) and (4.20) - (4.21) 
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uCt) - CH»r H)x(t) (4.24) 

(H'r H)A + A« (H'T H) - (H*r H)B r“^B* (H*T H) + Q = 0 (4.25) 

Equations (4.24) and (4.25) are identical to equations (4.18) and 
(4.17) respectively if Q is chosen equal to H’Q H. Of course this 
equality is not possible unless Q is chosen VJith rank equal to the 
number of outputs. For instance/ if the cost of the true model 
penalizes only the output vector then there are no problems. 

Aggregation theory simplifies the problem since now only a 
Riccati equation has to be solved to determine the optimal control, 
conpared with three coupled equations ( (4.19) - (4.22) ) in the solution 
proposed by Levine. Recall that even if we find a solution to Levine's 
set of equations, tiieie would always he the doubt of whether the 
solution obtained is optimal or not. Another advantage of the design 
method derived from aggregation theory is that the suboptimal control 
does not depend on the statistics of the initial conditions. One may 
argue, however, that if the aggregated model is fixed by the measure- 
ment equation and if the cost used to obtain the optimal control only 
weights those modes selected by the aggregated model, design defi- 
ciencies may result. Notice also that H has to be such that (4.4) is 
satisfied exactly and this will not always be possible. Even if (4.4) 
is satisfied exactly, H fixes the dynamics of the aggregated model 

disappears, equation (4.22) is not used anymore in obtaining the 
feedback control gain. Equation (4.22) is used only for obtaining 
the steady state second moment: E. 



and F will not necessarily have "the most significant portion of the 
dynamics of the true model”, it may also happen that some unstable 
eigenvalues in the true model are not included in the aggregated 
model. In this case, since no control is applied for these unstable 
modes, the plant will be unstable imder the control law (4.24) . 

Dimension control using STjfaoptimal observers via the 
aggregated ntodel 

In this section an approach to the optimal linear reduced 
order compensator design problem by means of aggregation theory is 
presented. In this methodology the nature of the system matrix A 
and observations matrix C (see (4.10)) is not so restricted as in the 
approach presented in the previous section (see (4.4)). Assuming the 
linear regulator problem has been posed for the true model, the main 
idea of the method consists of the following: 

i) Obtain an aggregated model with the most inportant 
part of the dynamics of the true model. Leave out only 
asymptotically stable modes. 

ii) Design an optimal minimum order observer-based compen- 
sator for the aggregated model (the required matrices are 
obtained using the Penrose inverse in the appropriate 
true model linear regulator parameters) . 

It IS shown that when this control law designed for the aggregated 
model is used on the true model the 


resulting closed loop system is 
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asymptotically stable. 

Consider the problem of designing an optimal observer based 
compensator for a large-scale dynamic system. In this problem there 
are two major difficulties: 

i) computation of the Kalman gain (usual Riccati equation) 

ii) computation of the parameters of the optimal observer 
[B2;Ml]f this requires solution of another Riccati 
equation. 

One may consider the possibility of reducing either the number of 
states of the true model or the number of states to be reconstructed 
so that the dimension of one or both Riccati equations mentioned 
above is reduced, of course, the resulting control law would not ba 
optimal but its effects might be acceptable for the application at 
hand. To prove whether the particular results are acceptable or not 
would require simulations and comparison with the optimal control law. 

The difficulties pointed out above may be avoided by use of 
aggregation theory. VJhen analyzing the approach taken, we have to 
keep in mind one of the most important results (in the author's 
opinion) of Aoki's paper [Al, p. 250], The true model will be stable 
mder a control law designed for an aggregated model if (see Appendix F 
for proof) : 

i) the control law is stable for the aggregated model 

ii) the system matrix A for the true model is in Jordan 
block diagonal form with ail the unstable modes included 
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in the aggregated model 

* , — , 

iii) H is of the form [H T 0] , where H is ftill rank. 

• 

Even if the above three conditions are not satisfied the plant may 
yet be stable under a control law designed for the aggregated model. 
The importance of the above three conditions is that they are suffi- 
cient to guarantee the stability of the plant under any stable control 
law designed for the aggregated model. This is extremely important 
when designing any control law. The three basic conditions mentioned 
above arp satisfied in the following design: 

Consider a plant described by a true model given bys 

xCt) = Ax(t) +B u(t); t e [0, +“) (4.26) 

y(t) = C x(t) (4.27) 

where : 

x(t) e is a random process with known e{x(0)} = 
and e{x(0)x' (0)} = 

u(t) e R is a linear function of y(') and the state of 
a minimum order observer.* 

y(t) E R^ is a random process with statistics derived from 
(4.27) 

and A, B, C are known real valued matrices dimensioned accordingly. 


*Here we are talking about a minimum order observer design as in 
Miller’s paper [Ml]. The structure of such compensator is not dis- 
cussed here because the design to be presented avoids its use. 
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The optimal feedback control law is to be obtained by mini- 
mizing the following performance index: 

Jiu) = E I {x' (tjQx(t) + u' (t)R u(t) }dt (4,28) 

•'0 

where Q ^ 0 and R > 0 are known real valued matrices dimensioned 
accordingly. 

Using the Jordan transformation obtain the Jordan equivalent 
true model given by; 

x(t) = A x{t) + B u(t> (4.29) 

ytt) == C X (4.30) 

where A is in Jordan diagonal foian. The Jordan blocks in A eire 
®5rganized so as to 'have the unstable and other important eigenvalues 
in the first Jordan blocks along the diagonal. Also, the cost (4.28) 
has heen trans:formed: 

J = E I {x'(t)Q X + u’R u)dt (4.31) 

•'o 


The matrices A, B, C, Q are related to A, B, C, and Q as follows 
(using x(t) = Jq x(t) , where Jq is the Jordan transformation discussed 
above) ; 


- 1 - 

A Jq a J 

B = 

C = F Jq 

Q = Jq 


0 


Because of the order imposed on A when diagonalizing use H = [I ! 0] 

{see section IV. II) to extract the most significant portion of the 
dynamics of the true model and in this way obtain the aggregated 
model. 


In order to completely transform the problem (4. 29) -(4. 31) so 
that the aggregated model can be used the following must be done; 

i) transform the output vector using the Penrose Inverse: 

y{t) = C(H»H)“^’z(t) = C z(t) (4.32) 


ii) and performance index: 


J r” 

I {z* (t) [H(H'H)”^Q(H'H)"^H'Ia(t) + u’ (t) R u(t) }dt 
n 


(4.33) 


Now a new optimization problem is defined; 

Given; 

a) the real valued matrices F(p x p) , D(p x r) for the 
aggregated model: 

z(t) = P z(t) + D u(t); t £ [0, 4«) (4,34) 

where e{z( 0)} and e{z(0)z'( 0)} are obtained as in (4.8)- 
(4.9), 

b) the real valued matrix C(m x p) for the measurement vector: 

y(t) = c z(t) (4,35) 

the weighting matrices: 

Q = H(H'H)"^Q(H'H)"^H' > 0 


c) 
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R > 0 


Minimize: 


J{u) = E f {z'Ct)Qz(t) + u’ (t)R u(t) }dt (4.36) 

*'0 


subject to: (4.34) and (4.35) and the following minimum order observer- 
based compensator structure (Miller [Ml] and Blanvillain [B2l): 


w(t) = F w(t) 


+ D u(t) + G y(t) 


(4.37) 


V7ith control law: 

z(t) = M w(t) + N y(t) (4.38) 

u(t) = P z(t) (4.39) 

where ; 

V7(t) z ^ is an obsein/er of z(t) 

z(t) £ 

•V ^ ^ 

The real value matrices F((p-m) x (p-m) ) , D((p-m) x r) , G((p-m) x ra) , 
M(p X p) , N(p X m) and P(r x p) are to be determined by minimizing 
(4.36). 

Using this approach the compensator will have dimension (p-m) 
which is less that the dimension (n-m) of the Luenberger observer 
proposed by Miller and others. 

If the above control is applied to the true model the resulting 
closed loop system is asymptotically stable. This is proved in 
Appendix F following the method used by Aoki. 



CHAPTER V 


OPTIMAL MINIMUM ORDER OBSERVER-BASED COMPENSATOR FOR 
A TIME-VARYING PLANT WITH A KDIO?1N INPUT DISTURBANCE 

V.I Introduction 

This chapter considers the problem of designing an optimal mini- 
mum order time varying observer-based compensator for a linear tine 
varying plant with a known input disturbance. The compensator para- 
meters are to be designed by minimizing the standard performance index, 
quadratic in the state and control vectors for the time interval 
[0, T] . The problem is treated in the context of stochastic processes 
due to the nature of the initial condition vector. The initial condi- 
tion is assumed to be a random vector v;ith knc^^^ first and second 
order statistics. The problem is considered in continuous time for 
the sake of simplicity. Although there exist significant differences 
between discrete time and continuous time problems, the results 
obtained can be easily translated to discrete time using a similar 
approach. 

It will be shown that a kind of separation theorem holds for 
this case. That is, the control and state reconstruction parts of 
the design problem can be solved independently. The approach is based 
on minimizing the performance index with respect to the control para- 
meters and \asing the necessary conditions of optimality to simplify 
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the original problem. The necessary conditions are simplified based 
on our knowledge of the solution for the complete state measurement 
case. In this way the control and estimation parts may be separately 
examined. The result obtained is that the observer parameters are 
determined by solving an optimization problem which is independent of 
of the control law parameters; the control law is the same as in the 
presence of complete state measurements. 

This chapter is structured as follows. In section V.II the state 
regulator problem for a plant with a known input disturbance vector is 
posed and and solved under the assumption of complete state measure- 
ments. In section V.III the problem in section V.II is solved with 
two additional constraints: only an incomplete state measurement is 
available and the missing states are to be reconstructed asymptotically 
by means of a minimum order time-varying observer-based conpensator. 

The solutions proposed only satisfy the necessary conditions for 
optimality. 

V.II Optimal control for a plant with a knoTO input disturbance 

In this section necessary conditions for the existence of an 
optimal control for a linear time-varying plant with a deterministic 
disturbance and perfect observations are derived. The problem is 
posed as a stochastic problem due to the nature of the initial condi- 
tions- The initial condition is assumed to be a random vector with 
knovm first and second order statistics. The performance index mini- 
mized is the standard cost quadratic in the state and control vectors 
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on the time interval [0, T] . The optimal control is assisted to be a 
linear combination of a feedback term and a bias control terra. The 
parameters of the optimal control are determined using the Minimum 
Principle. 

Optimization problem statement 

Givens a) the linear time-varying plant described by: 

x(t) = A(t)x(t) + B(t)u(t) + H(t)w(t) ; t E [0, T] (5.1) 

where 

x(-) is an R^-valued random process with knovm first and 
and second order statistics.* 

u(*) is an R^-valued linear function of x(*) generated by 
(5.2) 

w(*) is an R -valued known disturbance vector. 

The matrices A(t) , B(t), H(t) are known matrices with real 
continuously time varying entries dimensioned accordingly 
to x(*) r u(-) r and w{*) • 

b) the weighting matrices ^ 0, Q(t) 0 and R(t) > 0 

are known, 

Q e R" " 

T 

n X n 

Q(t) e 1? 

R(t) e ^ ^ 


*We will assume that x(0) is a random vector with known e{x(0)} and 
e{x(0) x' (0) } . Therefore (5.1) generates a Markov process whose first 
and second order statistics can be computed recursively. 
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Assumer the optimal control law to have the follov/ing form: 

u(t) = P(t)x(t) + g(t) (5.2) 

where the first terra on the R.H.S. is the linear state feedback 
terra. The second terra is the bias control term and has the 
purpose of counteracting the effects of the disturbance term 
H(t)w(t) in (5.1). P(t) and g(t) are real valued, deterministic 
and are dimensioned accordingly to x(-) and u(*)- 
Find: u(t) of the form (5.2) such that the following performance 

index is minimized: 


J(u) 


E{x’ (T)QyX(T) 


+ f x' (t)Q(t)x(t) + u'(t)R(t)u(t)dt} 
•^0 


(5.3) 


subject to (5.1) . 

The expectation is taken with respect to the initial conditions. 


Note; The matrices A, B, P and H will be v/ritten without explicit 
dependence on t for the sake of notational simplicity. 

Solution : 

Using (5.2) in (5.1) the state correlation E{x(t)x'(t)} and 
mean E{x(t)} can be obtained: 


3c(t) = (A + B P)x(t) + B g(t) + H w(t) 
therefore; 


x(t) = $(t, O)x(O) + 


f 6(t, 

■Jn 


T) (Bg(T) + K (t) )dT 


(5.4) 


(5.5) 


V7here : 
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eMOUUvT: 


<&<t, T) is the transition matrix of (A + BP), it allows 
calculation of the state vectoi at some time t, given complete 
knov;ledge of the state vector at time T in the absence of the 
term Bg + Hw. 

From (5.5) the mean of x(t) can be obtained: 

ft 

E{x(t)} = m(t) =®(t, 0)vXq t j ®(t, T) (Bg(T) + Hw(T))dT 

•'0 

(5.6) 

where = E{x(0)}. 

Taking the derivative of (5.6) with respect to time*; 

m(t) = (A + B P)m(t) + (Bg(t) + Hw(t)) (5.7) 


The correlation is obtained using (5.5); 


E{x(t)x'(t)} = 0(t, 0 )e{x(0)x' ( 0) }$• (t, 0) + 

+ f «>(t, t) (Bg(T) + Hw(r))dT E{x*(0)H* (t, 0) + 
Jq 


♦'0 


+ 4-(t, 0)E{x(0)}/ (Bg(T) + Kw(T))'0'(t, x)dT + 


r ®{t, 

•/o 


T)(Bg(T) + Kw(T))dt I (Bg(T) + 


/ 

•'0 


+ Hw(t)) '$• ( t, T)dT 


(5.8) 


*Recall two important properties of the transition matrix: 

i) T) = (A + B P)o(t, T) 

ii) <l>(t, t) = I 

where I is the identity matrix. 
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Taking the derivative of (5.8) with respect to time*: 

Z{t) = (A + B P)Z(t) + 2(t) (A' + P'B) + 

+ (Bg(t) +Hw(t))m'(t) +m(t)(Bg(t) +Hw(t))' (5.9) 

where 

Z(t) = E|x(t)x' (t)} (5.10) 

And m{t) is given by (5.6). 

Using (5.2) in (5.3) the cost functional can be expressed in 
terms of the correlation and the mean of x(t) : 

/•T 

J(P, g(t)) = j [tr|(Q + P*R P)S(t)[ +g'(t)RPm(t) + 

•'0 

+ m'(t)P'R g(t) + g' (t)Rg(t) ]dt t tr{Q^S(T)} (5.11) 

Now the optiraitation problem (5.1) — (5,2) can be ejfpressed as follov/s: 

Obtain the (r x n) matrix P, the (n x n) matrix S(t), the 
r-dimensional vector g(t) and the n-diroensional vector m{t) such that 
the following performance index is minimized; 

J(P/ g(t)) = I tr{(Q + P'R P)E(t) } + g* (t)R Pm(t) + 

•'0 

t m' (t)P>Rg(t) t g'(t)Rg(t)dt + tr{Q^2.(T)} (5.12) 

subject to; 


*Usually what is found is the autocovariance so that a differential 
equation v/ith no driving term is obtained. In our case we only find 
E{x(t)x'(t)} because ^his is the expression v;e v;ill need later. 
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m(t) “ (A + B P)m(t) + Bg(t) + Hw(t) (5.13) 

f (t) = (A + B P) 2 (t) + 2 (t) (A + B P) ' + 

+ (Bg(t) + Hw{t))m’ (t) + m(t) (Bg(t) +Hw(t))' (5.14) 

where: m(0) and 2(0) are known. 

Necessary conditions for (5.12) to have a stationary point at 
P* and g*(t) can be obtained using the Minimum principle (Athens and 
Falb [a 4] ) , In order to obtain such conditions a Hamiltonian is 
defined: 

H(P, 2(t), m(t), g(t),r(t), f(t))= tr{(Q + P'R P)2(t)} + 

+ g'(t)BPm(t) + m'(t)P'Rg(t) + g'(t)Rg(t) + 

+ r' (t) [(A + BP)2(t) + 2(t) (A + Bp) ’ + 


+ (Bg(t) + Hw(t))m’(t) + m{t) (Bg(t) + Hw(t))’J + 

+ 2f'(t)t(A + BP)m(t) + Bg(t) + Hw(t)] (5.15) 


where : 

r (t) is an n X n costate matrix 

2f(t) is an n-dimensional costate vector 


The necessary conditions for (5.12) to have a stationary point at p*, 
2*(t), m*(t), g*(t), r*(t), f(t) are: 


is. 

3P 


= 0 


(5.16) 



-82- 


3H 
32 (t) 


= -r*(t) 


(5.17) 


8H 
3m (t) 


= -f*(t) 


(5.18) 


3H 

3g(t) 


= 0 


(5.19) 


3H 

3F(t) 


= Z*(t) 


(5.20) 


3h 
3f (t) 


= m*(t) (5.21) 


where the notation I means "evaluated at: P*/ m*(t) , g*(t), 

I it 

r*(t), f*(t)." 

From (5.16) it follows that (using Athens [A3]): 

R P*2*(t) + Rg*(t)m'*(t) + B' f* (t)m'* (t) + B*r*(t)S*(t) = 0 


(5.22) 


(5.17) becomes: 


-r*(t) = (A + B P*) T*(t) + r*(t) (A + BP*) + Q P**R P* 

(5.23) 

From (5.18) it follows that: 

f*(t) = -(A + B P*)’f*(t) - r*(t) (Bg*(t) + Hw(t)) “ P*’Rg*(t) 

(5.24) 

(5-19) is: 
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(5.25) 


(5.26) 


R P*m*{t) + R g*{t) + B«r*(t)m*(t) + = 0 

From (5.20): 

E*(t) = (a + B P*)z*(t) + s*{t) (A + B p*) ' + 

+ (Bg*{t) + Hw(t))m*’(t) + m*(t){Bg*(t) + Hw(t))' 

And (5.21): 

m*(t) = (A + B P*)m*(t) + Bg* (t) + Hw(t) ( 5 . 27 ) 

Equations (5.22) -(5. 27) can be further simplified in the following 
way: 

Using the value of Rg*(t) from (5.25) in (5.22): 


(RP* + BT*(t)j rE*(t) - m*(t)m*' (t) ] =o 


(5.28) 


Since this equation has to be valid for any 2(0) and m(0) , and there- 
fore for any 2 (t) and in(t) , as long as an optimal solution exists we 
conclude that: 

P* = , 533 , 

Using (5.29) in (5.25); 

g»(t) - ,5 30, 

Using (5,29) and (5.30), (5.24) is reduced to: 

f*(t) = “(A - B R"^BT*(t))'f*(t) - r*(t)Hw(t) ( 5 . 31 ) 

Therefore the solution to (5.1}-(5.3) can be summarised as follows: 


u(t) = P*(t)x(t) + g*(t) 


(5.32) 
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where P*(t) satisfies; 

P*(t) = -r“^(L)B' ( t)r*(t) (5.33) 

and: 

r*(t) = -A’(t)r*(t) - r*(t)A(t) + r*{t}B(t)R(t)B*(t)r*(t) -Q(t> 

(5.34) 

obtained using (5.29) in (5.23). 
g*(t) is given by; 

g* (t) = -r“^ ( t) B > (t) f* (t) (5 . 35) 

where : 

f*(t) = ~[A(t) - B(t)R"l(t)a' (t)r(t) 3 ’f*(t) 

- r*(t)H(t)w(t) (5.36) 

where r*(t) !=• con'puted using (5.34). 

Boundary conditions of the above solution: 
i) For the equations (5.26) -(5.27) the knowns m(0) and 
S(0) constitute the initial conditions. 


ii) For equation (5,34) rhe transversality conditions of 
the Minimum principle give the boundary conditions 
(Athans and Falb [A43 ) * : 



* Here we use the part of the cost (5.12) that depends only on the 
terminal state second moment: tr{Q E (T) } 
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(5.37) 


iii) For (5,36; the boundary conditions are obtained in a 
similar ways 
8{J(P, q(t))> 


3m (T) 

which gives: 
f*(T) = 0 


f* (T) 


(5.38) 


Calculation of the optimal cost 

Using (5.29) and (5.30 ) , the performance index (5.12) can be 
ei^ressed as: 

J(P*, g*(t)> = f tr{(Q(t) + P*' (t)R(t)P*(t))S*(t)} 

*'0 

+ f*' (t)B(t)pr^(t)B* (t)r*(t)m*(t) 

+ m*' (t)r*{t)B(t)R"^(t)B' (t)f*(t) 

+ f*' (t)B(t)R“^(t)B* (t) f*(t)dt + tr{Q^S(T)} 


Using the trace identity; 

tr{A b} = tr {b a} 
and the value of 

B(t)g*(t)m*’ (t) = -B(t)R"^(t)B' (t)f*(t)m*‘ (t) 

from (5.26), (3.39) becomes: 

rT 

J(P*, g*(t)) = I [tr{(Q(t) + P*' (t)R(t)P*(t))S*(t)} 

•'o 


(5.39) 


(5.40) 


(5.41) 


+ tr{-r*(t)E*(t) +r*(t)(A(t) + B(t)P*(t))S*(t) + 
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+ r*(t)Z*{t) (A(t) + B(t)P*(t)) • 

+ r*(t)H(t)w(t)ia*' (t) + r*Ct)m*w' (t)H' (t)> 

+ f** (t)B(t}R“^(t)B' (t)f*(t)]dt 

+ tr{Q^S(T)} (5.42) 

which is equal to; 

= J tr|{Q(t) + P*' (t)R(t)P*{t) t r*(t)[A(t) 4- B(t)P*(t)l 
+ [A(t) + B(t)p*(t) ] T*(t)}S*(t)| - tr{r*(t)S*(t)} • 

• tr{r*(t)H(t)w(t)m*‘ (t) + r*(t)m*(t)w' (t)H’ (t) 

+ f** (t)B(t)R"^(t)B* (t)f*(t)}dt + tr{Q Z('T)} 


Using (5.23) and: 


— {r*(t)i*(t) } = r*(t)L*(t) + r*(t)E*(t) 


(5.43) becomes: 


- 

-'0 

+ r*(t)m*(t)w' (t)H' (t) + f*’ (t)B(t)p'”(t)B* (t)f*(t)dt 


r {—(r*(t)Z*(t))} + tr{r*(t)H(t)w(t)m*» (t) + 


+ tr{Q^I(T)} 
Therefore, using (5.37) 


J(P*r g*(t)) = tr{r*(0)I*(0)} + 
-T 


i: 


tr{r-{t)K('*jw(t)m*' (t) + 


(5.43) 


(5.44) 


(5.45) 


+ r* (t)m* (t)w' (t)H' (t) > + 
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+ f*> (t)B(t)R”^{t)B' (t) f*{t)dt 


(5.46) 


Equation (5.46) can be further reduced using (5.36) and (5.38), but 
it will be left the way it is for the sake of simplxcxty of the 
derivations that follow in the next section. 

V.III Optitnal minimum order obs e rver based compensator for a Ixne ^ 
t-ime-varvirq pT?^nt with a knov m in put ., disturoance 
In the previous section the optimal control for a linear time 
varying plant with quadratic C03t was designad. It was shown that 
tha optiTOl control law raquiras taowladga of tha whole state vector. 
This is an assunption that is seldom satisfied in practice. Usually 
what is known are linear coirbinatio.ns of the states’'. In this sec^ 
tion the problem of the previous section is considered under the 
assumption of incomplete state measurements. It is assumed that the 
control law has the same form as in the previous section but r!t) is 
replaced by X(t) , where S(t) is the state vector reconstructed 
asymptotically by means of a minimum order observer-based compensator. 
The parameters of the compensator are to be determined by minimiaing 
the standard cost quadratic in the state and control vectors over the 
time interval to, T1 . The optimisation problem is tackled by 
minimising the cost with respect to those parameters "independent" 
of the observer parameters and then using the equations obtain 

•Me are assuming that these linear lortoinations are independent and 
ZsB in number than the dimension of the state vector. 
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simplify the cost functional. The result obtained is a cost functional 
dependent only on the parameters of the compensator. It has the same 
form as the increment in cost due to the use of the observer obtained 
by Yuksel and Bongiomo [Yl, p. 611] for a plant with no input distur- 
bance. The section is organized as follows. First the compensator 
structiire is briefly reviewed. Then the optimization problem is 
defined, a solution follows. 

The plant considered in this section is the same as in (5.1) 
with measurements described by: 

y(t) = C(t)x(t); t e [0, T] (5.47) 

where : 

JTJ 

Y(-) is an 1? -valued random process with statistics derived 
from x(-) 

C^-) is an (m x nj time varying matrix. 

The structure of the Luenberger observer [L3] is the following: 

2{t) = F(t)z(t) + G(t)y(t) + D(t)u(t) + E(t)w(t) (5.48) 

x(t) = N(t)y(t) + M(t)z(t) (5.49) 

where : 

z(t) in an R'^^^-valued random process with statistics derived 
from: 

z(t) = T{t)x(t) - e(t) (5.50) 

and the matrices F(t), G(t) , D(t) , E(t), N(t), M(t) , T(t) and 
the vector e(t) are dimensioned accordingly- These matrices 
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are pare»etere that will be deterfined by Binimirlng the 

quadratic cost functional (5.63). 

, , . -i-rt Vitive the same form as in (5.32) : 

The control law xs assumed to have tne 

(5.51) 

u(t) = P(t)5i(t) + g(t) 

T 4 -^oo rvi D 140-141] are obtained using 
The followxng equalxties liJ-# P- 

(5.50) and (5-47) in (5.1) and (5.48) ; 

F(t)T(t) + G(t)C(t) = T(t) + T(t)A(t) ^ 

(5.53) 

D(t) = T(t)B(t) 

(5.54) 

E(t) = T(t)H(t) 


(5.55) 


and the error equation; 
e(t) = F(t)e(t) 

Equations (5.52)-(5.55) oohsiderably simplify '.he optimisation problem. 
The problem is simplified even more if all the matrices involved in 
equations (5.48) -(5.49) are expressed as a function of T(t) . The 
analysis of these derivations is presented in YOcsel and Bongiorno 

[Yll. 

Notice that if the term E(t)w(t) were not in (5.48) then the 
g^jrojT (5.55) wouXd bscomss 

e(t) = F(t)e(t) + T(t)H(t)w(t) 

which means that the nature of the term H(t)w(t) must be restricted if 

we want the error to decrease asymptotically to zero. 

Equation (5.49) can be simplified using (5.50) and the condition 

that x(t) is equal to x(t) plus an error-dependent term. That is: 
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N(t)C(t) + M(t)T(t) = I 
where I is the identity matrix. And: 
x(t) = x{t) ~ M(t)e(t) 


(5.57) 


(5.58) 


Then the control law (5. 51) becomes: 

u(t) = P(t)[x(t) - M(t)e(t)] + g(t) 


(5.59) 


The closed loop system equation can be obtained using (5.59) in (5.1) 


and (5.48): 


i(t) 

e(t) 


A(t)+B(t)P(t) 

0 




H(t)w(t) 

0 


B(t)P(t)M(t) 


x(t) 


B(t)g(t) 






F(t) 


e(t) 


0 


(5.60) 


In deriving (5.60) (see Miller [Ml] for a similar approach) the error 
equations were used instead of equations involving z (t) f for the sake 
of simplification. Another reasoi^ is that (5.60) gives insight to 
the structure of the closed loop system. That iSf the poles of the 
closed loop system are the poles of the plant for the case of couplet® 


state meastirement, plus the poles of the observer. 


Optimization Problem Statement 

Given; a) e{x( 0)} = m^ and e{x(0)x'( 0)} = X for the process* 

i(t) = A(t)x{t) + B(t)u(t) + H(t)w(t) (5.61) 


*For details as dimensions, etc. see section V.II and the introduction 
to this section. 
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y(t) = C(t)x(t) 

b) the matrices A<»), B(*)/ H(')» C(*) for the model 
(5.61)-(5.62) 

c) the time varying v/eighting matrices Q(*) ^0, 

and R(*) >0 with dimensions Cn x n) , (n x n) and (r x r) 
respectively . 

Find; the matrices’^ F*(t), T*(t), N* (t) , G*(t}, P*{t) and the 

vector g* (t) 

such that; the cost functional 


J(P{t), T{t), M(t), 
e{x* (T)Q^x(T). 



N(t) , G{t) , g(t) ) = 

X* (t)Q(t) x(t) + u' (t)R{t)u(t)dt} 

(5.63) 


subject to: 

u(t) = P(t)x(t;) - P(t)M(t)e{t)£^^"g(t) 
e(t) = F(t)e(t) 

F(t)T(t) + G(t)C(t) = T(t) + T(t)A{t) 
N(t)C(t) + M{t)T(t) = I 
e(0) = T(0)mQ - Zq 
and (5-61)-(5.62) 


(5.64) 

(5.65) 

(5.66) 

(5.67) 

(5.68) 


is minimized. 


tThe matrices D(t) and E{t) are not included here because they are 
determined from (5.5) and (5.6) once T(t) is obtained. 
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Note: 


The matrices A, B, P, M, F, H, Q, R, etc. are time functions, 
but their dependence on time will not be eiiplicitly v/ritten. 


Solution ; 

For computing the closed loop system mean and correlation: 
From (5.60) : 


x(t) 
e (t) 


9{t, 0) 




^Bg(x) + Hw(t) 

T) 1 5 

0 


(5.69) 



where t 


$(t, t) is tlie transition matrix of the system matrix: 


A + BP 


-BPM 


m 

x,e 



E 


(5.72) 
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x(t) 

r 1 

i— J 

1 

1 

( 

w 

Z » E 


x'(t) e'(t) 


x,e 

e(t) 

L J 

L^ia 



(5.73) 


The cost (5.63) can be e:^ressed in terms of and as follows: 


J(P, T, M, F, N, G, g) = e{x'(T)Q^x(T) + 


P lx’ 
-'0 


(t) e’(t)l 


Q + P'KP -F'RFM 
-M'P'RP M’P'RPM 



x(t) 


e(t) 

- - 


+ j^x'(t) e'(t)j 
g*Rg dt 


p'Rg 

r n 

’x(t) 


+ g'RP -g'RPM 


-M'P'Rg 

L J 

e(t) 

_ 


- 


(S.74) 


which equals f using the trace operator and interchanging it with the 
exnentation operator: 


X T 

tr 


+ m' 
x,e 


1 *'0 
P’Rg 
-M’P'Rg 


Q + P’BP -P’RPM 
'M'P'RP M'P’RPM 


x.e 


+ [g'RP -g'RPM] nijj g t g'Rg dt 


(5.75) 


Now the optimization problem (5. 61) -(5.68) can be tackled using 
equations (5.70), (5.71) and (5.75) instead of (5.61)-(5.65) . 

Following athans and Falb [A4] the Hamiltonian becomes: 

H(P, T, M. F, N, G, g, I / m^ , r, £, K . K ) = 

x,e x,e A A 

([q > P'RI 

= tr 



Q ■+ P'RP 

-P'RPM 



P'Rg 


-M'P'RP 

M'P 'RPM 

"^x,e 

+ m' 
x,e 

-M'P'Rg 


- 

_ 



” — * 


{ 
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Bg + Hw(t) 


+ tr' 


|k^ [ft + GG TA] + [NC + MT - nj 


(5.76) 


where the multipliers r((2n-m) x (2n-m)}/ f((2n-ni) x 1) , K^((n-m) x n) , 
X n) are time varying functions. Note that (5.68) is not in the 
Hamiltonian since this constraint is a boundary condition. It has to 
be considered when the transversality conditions are found. 

In the analysis that follows the necessary conditions for the 
existence of a stationary point P* , m*, g*, Z* and S* will be 
obtained. The resulting equations will be compared with (5. 32) -(5. 38) 
for the coitplete state measuremencs case as to simplify them. The 
resulting equations will be used to e^qjress the cost (5.75) as a 
function of the compensator parameters only . Following this procedure 
the problem is considerably simplified. The necessary conditions 
for a stationary point M*, F*, T*, N*, G*, Z* , m*, etc. are to be 
obtained by minimizing this simplified cost. 

Necessary conditions for the existence of a stationary' point 
P* , m*, g*, Z| and Z* : 
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where the partitions 



has been used. 



I* 


And using the partition: 



we obtain: 



( 5 . 77 ) 

( 5 . 78 ) 

( 5 . 79 ) 

( 5 . 80 ) 

( 5 . 81 ) 

( 5 . 82 ) 

( 5 . 83 ) 

( 5 . 84 ) 
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3H 


ar. 




(5.85) 


where 


means "evaluated at P*, m*, g*, Z* , S* / f*/ F* , F* 

* ^ h h ^ H ^2 


with transversality conditions (where J is given by the cost (5,75) ) : 


— =s r* (T) 

az (T) 


(5.86) 


— - F* (T) 

32^ (T) 


(5.87) 


Prom (5.77) is obtained: 

. RP*Z* - RP*mZ*' - EP*Z* M* + KP*mS_ k’ + Rg*m*' 

\ ^2 h h - 

- Rg*m'M' + -t B’F* S* - B'F* S* M' + 

e lx ± e x^ x^ 


+ B‘F* Z*‘ - b’F* Z M* = 0 
^2' 2 2 2 


(5.88) 


From (5.78) : 


-f* = (A + BP*) 'f* + F* (Bg* + Hw) + P*!Rg* 

J* . JL X 


(5.89) 


Prom (5.80): 


RP*m* - RP*Mm + Rg* + B'F* m* + B'F* m + B’f* = 0 

X c Ij^ X ^2 ® ^ 


(5.90) 


From (5.82) ; 


-F* = (A + BP*) *r* + F* (A + BP*) + Q + P*'RP* 

^1 


(5.91) 
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From (5.83) : 


-r? = (a + BP*) *r? + r* F - r. bp*m - p**rp*m 
2 2 ^2 


(5.92) 


From (5.84): 


S* = (A + BP*) 2* - BP*M2** +2* (A + BP*) * 

ll 


- 2* M'P*^B' + (Bg + Hv7)m*’ + m*(Bg + Hw) • 


X 


(5.93) 


From (5.85) i 

2* = (a + BP*) 2* - BP*mE + 2* F’ + (Bg + Hw)m‘ (5.94) 

h h h h ^ 

And boundary conditions: 

r* (T) = Q_ (5.95) 

H , 

r* (T) = 0 (5.96) 

^2 

The above equations can be simplified as follows? 

Comparing (5.91) with (5.34) and (5.95) with (5.37) is clearly 
seen that if ' 

P* = -R“^*r* (5.97) 

^1 

then the solutions T* / P* given by (5.97) , (5.91) and T*, P* for 

the complete state measurements case (see (5. 33) - (5.34) ) are identical 

respectively. 

If (5.97) is used in (5,92), then 
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r* = -(A + BP*) «r* - r* p 

2 I2 ^2 

with boundary condition: (5.96). 

Prom (5.9S) : 

Ti (T) =f'(T/t)r* Ct)^,(T/t) 

2 ,2 

where: is the transition matrix for (A + BP*) • and 

§2 transition matrix for F. 

Using the boundary condition (5.9f) it is concluded that: 

r* (t) = 0 , t e (0, TJ 

2 

since (5.99) has to be valid for all t. 

Using (5.97) in (5.89) ; 


(5.98) 


(5.99) 


(5.100) 


-f? = (A + BP*) 'fw +• r* Hw 

1 Ij^ 


(5.101) 


which is identical to (5*36) for the complete measurements case. It 
is clear that if we use: 


g* = 


(5.102) 


then the parameters P(fc) and g(t) of (5.51) are identical to the ones 
obtained for the perfect measurements case (see (S.32)-(5.36)) . 

Using (5.97), (S.loO) and (5.102) in (5.88): 


P*M2*' = p*m 2 t|t 
^2 2^ 


(5.103) 


Using (5.97), (5.100) and (5.102), (5.90) becomes: 



-99- 


P*Mni =0 (5.104) 

e 

Using (5.97), (5.102), (5.93) and (5.104) , (5.75) is simplified as 
follows: 

J(t,M,F,N,G) = tr{Q S (T)} + r tr{[Q + T* BR ^T* + 

\ •'O ^ ' 1 

+ r* (A + BP*) + (A + BP*) 'r* ]2* “ r* zp 

ij ^ •*- 1-^1 •*•11 


+ tr{r* Hw m*’ + r? m*w'H’} •^ 

H 1 

+ tr{M'P*'RP*t'E2 } + fl'BR-^B'fJdt 


Using (5.97), (5.91) and (5.44) , (5.105) becomes: 

J(T,M,F,N,G) = tr{r* (0)Z*{0)}+ f tr{r* ] 

It .^0 1 


(5.105) 


Hv; m** + 

X 


+ r* m*w’H’} -f- f*'BR”S’f*dt + 

llX 1 1 


f’T 

I tr{M‘P*'RP*MZ„ }dt 
-'O 2 


(5.106) 


where a trace identity has been used to put it in a format simxlar to 
(5.46). 

In order to compare (5,106) with (5.46) the . following analysis 

is done: 

Prom (5.70) : 


m* = (A + BP*)m* - BP*^3m + Bg* + Hv: 
X ■ ■ X e 


(5.107) 


Using (5.104), (5.107) becomes: 
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tn* = (A + BP*)m* + Bg* + Kw {5.108) 

Comparing (5.108) with (5.13) £or the complete state measurements case 
it is clear that m* and m* are identical since A, B, P*, g*, H, w are 

X' - ■ ■ 

the same for both cases. 

Now it is clear that the first four terms on the R.H*S of 
(5.106) are identical to the optimal cost (5.46) for the complete state 
measurements case. Therefore these are due to the control law (5.51) 
and are independent of the state reconstructor structure. Even without 
comparing (5,106) and (5.46) it can be noticed that the necessary condi- 
tions for obtaining the observer parameters are invariant with respect 
to these four terms. Therefore the optimization problem for obtaining 
the compensator parameters can be posed as follows: 

Minimize : 


J(T,M,F,N,G,z^) 
subject to: 



tr{M'P*'RP*MS, 


}dt 

2 


(5.109) 




+ S P' 


(5.110) 


FT + GC = T t TA 

NC t MT = I 

m = F m 
e e 


(5.111) 

(5.112) 

(5.113) 


e(0) = T(0)itig - Zq 


(5.114) 


where the constraints (5.108)“(5.112) are obtained from (5.65)- (5.68) 


and constraints in (5.76) not considered in the previous necessary 



conditions 


The optimization problem ( 5 . 109 ) -(5.114) is equivalent to the 
following: 
minimize : 

e' (t)M'P*‘RP*Me(t)dt (5,115) 

0 

subject to: 


e(t) = Fe(t) (5.116) 

FT + GC = T + TA (5.117) 

MC + MT = I (s.iia) 

, e(0) = T(0)mQ “ Zq (5.119) 


The importance of the solution proposed above is the separation 
property implicit in it. That is> the control parameters P*(t) and. 
g*(t) in the control law 

u(t) = P*(t)x(t) + g*(t) (5.120) 


are independent of the state reconstructor optimization problem. This 
is concluded because the equations for obtaining these parameters 
are identical to the corresponding ones obtained in section V.II for 
the complete state measurements case. On the other hand, the state 
reconstructor parameters are obtained defining an optimization problem 
which is completely decoupled of P* (t) and g*(t). In fact, the opti- 
mization problem (5.115)-(5.119) is identical to the one formulated 
by Yuksel and Bongiorno (Yl) for the case of no input disturbmice. 



- 102 -* 


Therefore, from (5,97), (5.91), (5.102), (5.101) and the optiroiaation 
problem (5.115) -{5, 119) we conclude that the control and state recon- 
structor optimiaation problems can be analyzed and solved independently 
since no coupling between these two problems ejeists. 

We have to emphasize that the solution proposed satisfies the 
necessary conditions but sufficiency has not been shoTO yet. Given 
that this part of the proof of optimality is lengthy and similar to 
l*Iiller*s (Ml, p. 150-152] it will n<^t appear here. 



CHAPTER VI 


VI. I ConcXusj.on.' 3 and Discussion of Resulis 

Chapter II 

The c^txmal discrete time minimum order observer-based compensa- 
tor problem has been solved. The necessaiy conditions for optimality 
were obtained and it was shown that a control law identical to the one 
for the complete state measurements case satisfies these conditions. 

The sufficiency part of the proof has been briefly discussed on the 
basis of Miller's results [Mlj. The Riccati equations obtained have 
been analyzed, based on a comparison with the Riccati equation for 
the discrete time linear regulator problem with no cross term in the 
cost. In fact it has been shown that the stabilizability of the pair 
[a, B] and observability of [a, C] play an important role in the 
obtainment of an asymptotically stable closed loop system. 

It has been shown that, as in the continuous time case, there is 
a separation property implicit in the design. That is, the optimal 
compensator structure turns out to be obtained by solving two decoupled 
and independent design problems: finding the optimal feedback control 
gains and finding of the state reconstructor parameters . The optimal 
control gains have the same form as for the case of conplete state 
measurements and as such only depend on the plant model and the cost 
v^eighting matrices. On the other hand the compensator parameters 
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(obtained once t»70 matrices are determined, i.e. and T2) depend only 
on the plant model and the initial condition statistics. It was shown 
that the optimal cost is invariant with respect to one of these matrices. 
From this result it was shown that the optimal conpensator parameters 
are nonunique since this matrix is arbitrary. Nevertheless the com- 
pensator dynamics are unique since any two optimal observers are related 
by a similarity transformation. Given this equivalency between optimal 
compensators the compensator structure was fixed (taking this arbitrary 
matrix as the identity) . Then it v/aS shown that a change in state-out- 
put canonical fosnn changes tlie optimal observer structure by a simi- 
larity transformation. Even more, the compensator dynamics as well as 
+■>10 total optimal cost are invariant under this kind of transformation. 

Chapter III 

The necessary conditions for optimality of the discrete time 
version of the optimal output feedback controller have been obtained. 

The results were achieved by two different methods which illustrated 
important optimization techniques in discrete time systems design. 

Also the discrete time versions of the optimal limited dimension com- 
pensator design by Johnson-Athans and Sirisena^Choi have been presented 
and briefly discussed. These kind of optimization problems are solved 
by reformulating them, via augmented matrices, as output feedback 


control problems. 
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Chapter IV 

The output feedback control problem has been analyzed in the 
context of aggregation theory. It has been shown that is is possible 
to simplify Levine's results as to decouple the Riccati and Liapunov 
equations and achieve independence of initial conditions. There exist 
various difficulties with this approach. For instance, the resulting 
aggregated model may not have the most significant portion of the plant 
dynamics and second, the measurement and system matrices are constrained 
an equalily that may not always be satisfied. 

A way of reducing the compensator dimension by means of aggre- 
gation theory has been proposed. It was shown that to provide control 
only for the unstable and other o;,r,t mnfes of ^ 

reduces the order of the compensator. It has been shown that, fixing 
the design method using Aoki's results, the design for the aggregated 

modal uan be applied to the true plant yielding an asynptotically stable 
closed loop system. 

Chapter V 

The regulation of a linear time varying plant with a known input 
disturbance by means of an optimal control law with an optimal minimum 
order observer has been studied. The necessary conditions for the 
optimality of the compensator structure have been obtained. It has 
been shown that the control gains for the case of complete state mea- 
surement satisfy these conditions. Moreover the result obtained is a 
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decoupling and independence of the control and state reconstructor 
parts of the problera. The sufficiency of these results can be proved 
by an approach similar to Killer's [Ml], It also has been shown that 
the optimization problem for obtaining the observer parameters is 
identical to the one obtained by Yuksel and Bongiorno [Yl3 for the 
case of no input disturbance. An important remark is that these 
results are only valid v?hen idle observer has knov7ledge of the plant 
input disturbance for all t. 

VI. II Bossible Extensions and the Related Research 

A possible extension of the results obtained in Chapters II 
and III would be a comparison of the methods presented# based on 
performance and sensitivity analysis. Also a step response comparison 
may give insight into the problem. The implementation of these 
designs in a discrete time linear time-invariant plant, or appropriate 
simulation might enhance the analysis . 

By means ^ of a matrix partition similcir to the one \ised in 
Chapter II the optimal reduced order observer-based compensator can 
be studied. The invariance of the compensator dynamics under a simi- 
larity transformation on the observer may be analyzed.. For instance, 
working out the example of a reduced order compensator by Fortmann and 
VJilliamson [pi] using a matrix partition, some insight in the problem 
is gained. For this particular case it turns out that the compensator 
parameters which reconstruct asymptotically the optimal control law 
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are completely determined from a set of constraints obtained from the 
partitions. Changing the partition, it can be sho\TO that the compen- 
sator parameters are non unique. The only difference between them is 
a similzurity transformation on the observer- Surprisingly enough, 
the conpensator dynamics are alv;ays the same. It is clear that in 
cases like this to define an optimization problem so as to find the 
parameters of the compensator has no meaning unless the class of 

admissible gains is properly stated. 

Concerning the output feedback control problem in the context 
of aggregation theory, the results obtained in Chapter IV indicate that 
considerable simplification is obtained if an equality constraint on 
the system and measurement matrices is satisfied. A possiuxe excensron 
of the restilts that appear on this chapter would be to define an 
approximation so as to validate the results obtained for a broader 
class of systems. This is a problem that can be studied in further 
detail up to the point that significant simplification of Levine's 
results is obtained. 

Also, further research effort can be dedicated to implement 
the results proposed on the reduced order observer-based compensator 
via aggregation theory. A conparison of this methodology with the 
ones presented in Chapters II and III is desired in order to demon- 
strate the validity of this approach. 


APPENDIX A 


Conditions for the existence and uniqueness of positive 
definite and positive semidefinite solutions of the standard steady 
state Eiccati equation (see Kv/alcemaak and Sivan [KG , p. 495] ) , 

Etor the following discrete steady state Riccati equation 
(obtained when there is no cross term in the cost (2,3) : S = 0) 


r - A*r A + Q - (B‘r a)* (R t BT B)“^CbT a) (A.1) 

or equivalently (see Appendix D for case C = I) i 

CO , 4>_ t 

r = £ (A’ + P'B') (Q + B) {A B B) (A.2) 

t=0 

= (A’ + P’B')nA + B P) + Q + E’E P (A. 3) 

where; 

F = (R B'f B) “^'(B^ J ^ 


the foilowing results hold. 'Ihese are derived as a iimiting case of 
the foilowing equation: 

r(t) = (A’ + P’ (ttl)B‘)r(t+l) (A + B P(t+D) + Q t 

+ P’,(t4-1)R P (t+1) (A.S) 

where ; 

P(t) = -(R t 

v;ith boundary condition r(T) . 
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Theorem A.l 

If (A/ B) is a controllable pair, r(T) ^ 0 is boundary condi- 
tion, then there exists a convergent sequence {F (t) } which is element- 
wise positive semidefinite. The limit, as T goes to infinity, F 
satisfies A,1 and is positive semidefinite. 

Theorem A. 2 

If theorem A. 1 is satisfied and (A, is an observable 

pair, then -there exists a unique positive definite solution to (A.l)- 
(A.3) and it yields an asymptotically stable closed loop system. 

The above tvjo sufficient conditions, originally proposed by 
Kalman [K1-K33 for continuous time version, were weakened by Wonham 
p7ll for continuous time in 1968 i The discrete time results were 
presented in 1970 by Caines and Maine [Gl] . 

Theorem A. 3 

If the iteration (A. 5) is started at F {t) ^0 and -the pair 
{A, B) is stabilizable then there exists 0 < F < -M” such that the 
sequence {F (t) } converges to a constant steady state solution F . 

Tliis F satisfies (A.1)-(A,3). 

Theorem A, 4 / 

If theorem A. 3 is satisfied and the pair (A, is observable 

then F > 0 is unique and yields an asymptotically stable closed loop 
■ -system.' ' 


APPENDIX B 


Analysis of equation (2.51) 


Consider the recursion: 


r* (t) = (T*ALT*“^^'r* (t+i) {T*ALT*“^) + 
22 2 22 2 


'L’P*'B’r* B P*LT*“^ + (T*“^) ’L’P**RP*LT*~^ 

2 2 2 2 

(B.l) 

notice that if m+r > h, where r is the number of inputs, m is the 

number of outputs and n is the number of states, then {F* (t) } is 

automatically positive definite for any F (T) ^ 0 since the sum of 

^2 

the last two terms is positive definite. The series {F* (t) } is a 

-1 ■ ^ 

convergent series if (T*AIiT^ ) has eigenvalues of moduli less than 1. 
The latter condition is an implicit assumption in the well posedness 
of the problem. 

If the above conditions are not satisfied, then an analysis in 

terms of observability and controllability has to be done to determine 

conditions sufficient for the positive definiteness of the steady 

state solution F* . Putting (B.l) in the following form (using equa- 
■^2 ' 

tions (2.18) and (2.21)) t 


F* =■ (P*‘)^(M*'P*'B'F* BP*M* t M*'p*^RP*M*) (F*)^ 


(B.2) 
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we can clearly see Cusing Appendix ft) ihat if the pair (F*,P*M*) is 

observable then Ct) } is a convergent positive definite sequence 

2 

provided that P is a stable matrix and (T) is positive semidef inite , 

2 :. ■ .. 

All this condition, says is tliat the observer has to bra minimal in 

order to have T > o. This is an implicit assumption in section 

II .III when the dimension of the observer was fixed to be n-m and 

the plant assumed minimal- 



APPENDIX C 


Invariants of discrete time optimal minimum 
order observer-based compensator 

In this appendix it is proved that any two similar state-output 
discrete time canonical plant models yield the same optimal compensator 
dynamics and optimal cost. The analysis follows quite closely the 
analysis for the continuous time case followed by Blanvillain and 
Johnson [B3] . 

The appendix is structured as follov/s. First a review of a 
method to obtain the state-output canonical plant model from any other 
realization is presented. Then, optimal minimal order observer-based 
compensators are designed for two equivalent state output canonical 
plant models. As in Blanvillain and Johnson a matrix decomposition 
and a matrix equivalence are used in order to compa; r these too 
designs. In this v^ay it is shown that different state output plant 
canonical forms yield observer design parameters which are related by 
a similarity transformation. Also it is shown that these too designs 
yield the same optimal cost. 

For a plant described by the following linear time invariant 
model, (see section IX. II for details ou dimensions etc. } t 

x(t+l) = A x(t) + B u(t) (C.l) 

y(t) = C x(t) 
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(C.2) 
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V7ith. initial condition statistics:^^^^^^^ ^ ^^^^^^^ 

e{x(0)x’(0)} = S (c;3) 

E{x(0)} = (C.4) 

with optimal control given by (see Sectiont II. IV) : 

u{t) = P x(t) (C.5) 

x{t) = N y{t) + M z(t) (C.6) 

z (t+l) = P z (t) + G y ( t) + D u (t) ; z (0) = * I]m^ 

(C.7) 


designed by minimizing the following performance index; 



(C.S) 


Consider the folloi^ing similarity transformation which puts (C.l)- 
(C.4) in state-output canonical form: 

x(t) = H x(t) (C.9) 

where H(n x h) is obtained as follows: 



(C.iO) 


where A ( (n-m) x n) is an arbitrary matrix such that H is full rank . 
The freedom in selecting this A is v/hat makes this transfortnation non- 
unique. The transformation is selected as above because then the 


tThe asterisks indicating the optimality of the parameters have been 
dropped for notational convenience. 
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iTieasurement equation (C.2) becomes; 

y(t) - C H ^x(t) = [I I 0] x(t) (C.ll) 

since; 

H ==1 (C.12) 

and; 

c h”^ - [I : 0] (C.13) 

As shown in Blanvillain and Johnson, there exists a unique 


matrix decomposition for A; 

A = VC + N;NC’=0 (C.14) 

where V((n-m) x m) and N(Cn-m) x n) are given by; 

Y ■= A c* {C (C.15) 

N = A(i - C’ (G C*)~^C) (C.16) 

H ^ can be partitioned in an analogous form to i *' 

IG A] (C-IV) 

where the matrices C(n x m) and A(n x (n-m)) are given fay; 

C = G* (C C')~^ - N’ (N N')”^V (C.18) 

A = N' (N N’)“^ (C.19) 


1 : ■ 2 

It can be shown [83] that for any two A’ s; A and A with 'unique 
decompositions as in (G. 14) , there exists a imique nonsingular matrix 
W((n-m) X (n-m) ) such that 


-2 ~3 

IJ = W N-** 


(C.20) 



115- 


where N^/ correspond to and respectively. 

The relations {C.14)-(C,20) play a very important role in the 

proof that follows. 

Under the transformation (C.9) f the plant model {C.1)“(C.4) 


hscomes: 

x(ttl) = H A H"^x(t) t H B u(t) 

y(t) = [I : 0] x{t) 

with initial condition statistics given by: 
E^xCO) } = H iHq 
E{ x [0) X’ (0) } = H S H' 

The optimal control (C.5)-CC.7) is also modified 
u(t) = P X 

■^(t) = H Nfl : 0]x + H M Z{t) 


(C.21) 

(C-22) 

(C.23) 

(C.24) 


(C.25) 

(C.26) 


z(t+l) - F z(t) + G y(t) + D u(t) ; z(0) = [T : X]H m^ 

(C.27) 

for the performance index: 

00 , _ 

J = E x|(H' )~^Q H — x^ ®“t 

t=0 . - 

\ 

Using the partitions (C.IO) and (C. 17) some of the above matrices can 
be e>^resssd as follows: 
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C A C 
A A C 


H B 


C B 
A B 


H mo = 
H S H’ 


G 


A m, 


0 

c 2 c 
A Z c 


I 


I 


C A A 
A A A 


C 2 A' 
A 2 A' 


(C.29) 


(C.30) 


(C.31) 


(C.32) 


In the analysis that follows optimal minimal otder observer- 
based compensators as in (C. 25)- (C. 27) are designed for two equivalent 
systems of the form (C. 21) -(C. 24) . The only difference between these 
two systems is the A-matrix used in the transformation (C.IO) , (C.9) . 
Bor notational conveniencs these systems -and corresponding designs 
are differentiated by the superscripts 1 and 2. 

Following the results obtained in Section II »IV the compensator 


design parameters corresponding to A , where i = Ij- 2/ are: 
From (C.25)-(G^26) and (2.18) -(2. 19) with T 2 - I: 






“ 

r n 


r 

" 


0 


■I 



I 

1 ■ :■ 

0 



- ■ - 


- 



{C.33) 


(C.34) 
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From (C.27) and (2.12), (2.21), (2.22) for Tg 

pi _ g,i 

1 I2 ^2 


^ i i i _x„i 

•*• 1 


= I: 


° = *** ®2 


1 X X X 

2 (0) = “1 "'2 


where the partitions to be used are: 


"^1 



c A C 

C A A 

1 

2 




A ; ■ 



A A C 

A A A 

^1 

^2. 





®1 


C B 



A B 

_ 

— — 


r 

“1 


c m 

L. M 


Am 


(C.35) 

(C.36) 

(C.37) 

(C.38> 


(C.39) 


(C.40) 


(C.41) 


obtained from (c.29)-(c.31) respectively, with the appropriate stper- 
eoripts. according to SecUon II.IV, and are given by, 


From (2.62): 

p"* = -(R rf bS“'-(b^' rj + s^') 


(C-42) 
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where is given by (2.63) : 


- (B^’ rj- + s^')' • 

h h -^1 

. (E + bVW + s"’) 

ll 


(C.43) 


Finding P from (G.42) and using? 


- H^B 






(C.44) 

(C.45) 

(C.46) 


obtained from (c.21) -(C.32) , we obtain j 


1 ^ 

P == -(R 




(C.47) 


I.et; 


r. = 


(C.48) 


andt 


then 


p = -(R + bTj B)”^CB'rj^ a + S') 
■^1 1 


(C.49) 


1 1 

P = P H 


(C.50) 


(C.48) can also be obtained from (C.43) for i == 1. 

The case for i = 2 is treated in the same way as above. The 
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results obtained are as follovra: 


1 1 
and P as in (C.49) : 


2 2 

P « P H 


From (2.64) 


- 


^ 2^1 ^2 ^2 ^1 ^1 
2 2 2 1 


i i' -i „i i'-l 

“l"l + ^1^2 Ai ) 

2 2 2 


where K„ is given by (2.65) 

2 

4-4A4'^4 “ 

2 2 ^2 2 2 


i 1’ ^ X 1 iV 

^^1 “ “ 2”*1 "*■ *2 ^2 ^1 ^ 
2 2 2 2 


i i' . _i „i -i’ -l,_i 

“I*"! ■*■ ^1,^2_^1„^ ^^1„ 

2 2 2 2 


XX' , ^x „x ,x\ 

’^ l "‘2 ^1 ^2 ^2 ^ 

2 2 2 


where the partitions to be used are (obtained from (C.31)-(C.32) ) ; 


^1 ^1 
1 2 

^2 

•*•2 '*2 


C 2 C' c 2 A' 


A 2 c’ A2A' 



C ra_ 


(C.56) 
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k«.ai 



and (C.39)-(C.40) with the appropriate superscripts. 

Using (C.14), (C.19) , (G. 39) and {C, 55) in (C.53) the following 
is obtained: 


^ = -N^(2C* - mni*C‘ + )‘'^N^A'C') 


• (c E C* - C Ecn 


: I ■; i ' -■( i -l~i -1 i 

•C’ + CAN (N N ) (N N ) N A'C) -V 

(C-57) 


Using CC.14) , (C.19) , (C.39) and (C.55) , (C. 54) becomes: 

= N^a N^‘ (N^^’)"^K^ (N^N^')''^N^A'N^’ + K^(S - mm’)N^* 

2 „ 2 „ 

2 2 

- W^(EC* - mm'C' + A N^’ (N^^*)"^^A'C’) * 

^2 • 

*(C £ C‘ - C mm'C' + CAN^' (N^^’)"^^ (N^^')“^^A'G')"^. 


• {C E - C mm' + CAN^' (K^^‘) “^N^A^jif^' 

2 


(C.58) 


Comparing (C.57) for i = 1 and 2 based on (C.20) , we conclude: 


■rj = W(tJ + V^) - CC.59) 

Comparing (C.5S) for i = 1 and 2 based on (C.20 ) , we obtain: 

K 2 = W K 2 V7* (C.60) 

2 2 

The relations {C.50) , (C.52) and (C.59) - (C.61) are useful in simpli- 
fying (C. 33) - (C. 37) for i = 2 as follov;s: 


a) From (C.33) with i = 2 and using (C.14) : 
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t= P H 


0 2 I 

T- + 

1 1 0 


(C.61) 


Using {C.17)-(C.19) and {C. 20) we obtain: 

pV = PE-N^(N^N^’)"'^(tJ + V^) + C'(C (C.62) 


Finding P N the same expression on the R.H.S. of (C,62) 
is obtained; therefore: 

^ pljjl 


b) Using (C.19) , (C. 34) for i = 2 becomes: 
P^M^ = P ^ 1*°1 


Using (C.17), (C.19) and (C.20) ; 

22 - I * -1 -1 

P M = P N-^ (nV ) 


If is found as above and compared with the 

R.H.S. of (C.65) , we conclude- that: 

2 2 „1 1 -1 
PM = P M W 


c) (C.35) for i = 2 equals: 


^^2 2^ 


Using (C.59)> {C.39) and (C.14) > (C.67) becomes; 


2 1 1 ~2 -2 "'2 
P = W(T^ -S- V ) C A A + N A A 


using (C-19) , (C.20) and (C.14): 


- 122 - 


5 "! .1 - 1 - 1 ' -1 -1 

P'^ = W(TJ-C A + A-^A}N-^ (N-^N ) W (C.69) 

Using CC.19) and (C.39) for i = 1 we conclude: 

= W(tJa?; + aJ )w“^ = W P^7“^ (C.70) 

2 2 

d) In a similar way as above , (C. 36) for i = 2 can be 
simplified: 

= T^A^ + A2 - (C.71) 

■ -^1 1 

using (C.59) , {C.39), (C.14), (C.19) , (C.IS) and (C.20) 
as; 

= W (C.72) 

e) {C. 37) for i = 2 becomes ; 

0^ = (C.73) 

112 

Using (C. 59), (C.40) and (C.14) , (C.73) is simplified: 

0^ = W 0^ (C.74) 

f) and (C.38) for i = 2: 

Z^(0) = T^m^ + m^ (C.75) 

Using (C.59) , CC.41) , {C^14y > (G.2a) and (3.38) for i = 1 
we can show that: 

2^(0) =W Z^(0) (C.76) 
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Xt is clear from equations {C,63) , (C.66), (C.70) / {C.72) , (C.74) 
and (C.76) that different state-output plant canonical models (obtained 
by changing A in (G.IO) ) yield optimal observers related by a similarity 
transformation. From (C. 70) it is also clear that the optimal observer 
dynamics are invariant to a change in state-output plant canonical form. 

In the analysis that follovre we intend to show that the optimal 
cost for this optimal compensator design problem is independent of the 
state-o'atput transformation used. Before proceeding with this proof 


the previous results are tabulated: 


Equation reference 

from {C.21) 
from (C.21) 

[1 ; 01 from (C.22) 
from (C.24) 
from (C.23) 
from (C.28) 
from (C.28) 

R from (C.28) 
pi from (C.25) 
from (C.43) 

^1 

from (C.53) 

1 


TABLE 1 


Corresponding matrices 
for design i =1 

Corresponding matrices 
for design i = 2 

1 , 1-1 
H A(H ) 

h\(h^)"^ 

H=-B 

H^B 

tl ! 0] 

m 

H 

O 


2 

“o 


(h1)“1s 

(h2)“1s 

(h1')“1q(H)“1 

(h^’)"1q(h^)”^ 

R 

R 

P (h1) “1 

P (H^) “1 

(Hi‘)-ir (h1)"1 

ll 

ll 


„1 = W(t1+v1)-V^ 

1 11 
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from (C.54)' W* 

2n 2^ 2^ 2„ 


from (C.33) 

2^ 

^2 22 

^2 2 „1 1 
P N = P N 

pV from (C. 34) 


2 2 11-1 
PM = P M W 

i 

F from (C.35) 


p2 _ 

from (G.36) 


G^ = WG^ 

from (C.37) 



zj from (C. 38) 


2 1 

Z = V7Z-^ 
0 0 

The optimal cost. 

when an optimal minimum order observer-based 

compensator (see Chapter II) is used, is given by: 


J* = tr{r S> + tr{r (T Z T')} 

^1 ^2 

(C.77) 

This e:i^ression is obtained from (2.33) using (2.52) 
Recall that the T*'s have the form: 

and r = 0. 
^2 

* 

T = [Tj^ : I] 


(C.78) 

In (C.77), r is given by (C.43) and F by: 
^1 ^2 


F, = P'T^ F + M' 
2 ^2 

(B'F^ B + R)M 
1 

(C.79) 

which is obtained using 

(2:^1&)), (2..21)' and; T = I in 

2 

C2.-51); , An aly zing 


(C.79) for designs i = 1 and i =2 the following results are obtained: 


For design i = 1; 

1 I'll I'l'll 1 

Tg = + M-^ (B-^ rj- + R)14 

2 2 1 


(C.80) 
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For design 2: 

= F^'r^ + M^‘ + R)M^ (C.81) 


Using results on Table 1, (C.81) becomes 


vl -• (W)“Wt^ W P^(W)“*^ + 

^2 **2 

(B’H^'Tt (C.82) 

^1 

Using and B^ from Table 1/ premultiplying (C.82) by W and 

^1 ^1 

postmultiplying by W we can compare (C.82) with (C.80) and obtain the 
followings 

ri - W'ri B ■ (C.83) 

^2 =2 

Calculating the optimal cost for designs i = 1 and i = 2 the following 
results are obtained: 


For design i = 1; 

= tr{(H^‘)"^r (hS~^(H^ 2 H^‘)} + 

1 

trCrJ (tV Z H^'t^')} (C.84> 

2 

This was obtained using and from Table 1 in (C.79) . Using a 

1 

trace identity and (C.32) , (C.78) , (C.84) becomes: 

jl* = tr{r Z} + tr{r^ (T^C Z C' T^’ + Z C'T^ + 
ll 22 '. 1 1 

+ tJ;c z a^' + a^ z a^’)} 


(C.85) 
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Using (C.14) , (C.85) can be escpressed as: 

jl* ^ 2} ^ [ (tJ' + V^)C 2 C’ (Tt" + V^) ' 

1 2 ^ 

+ 2 C {T^ + V^) • + (tJ- ■{• vhc S 2 N^'] (C.86) 

JL ■!■ 


For design i = 2 the same SJf^ression as in {C*S6) is obtained but with 
superscripts changed: 

= tr{r, 2} + tr{r^ E(T? + v^)C 2 c* ( 1 *^ + V^) ’ 

_ 1 2 • 

* v 2 2 2 2 2 "^2 * *^2 ^^2 * 

+ N 2 C (T^ t V ) * + + V )C 2 N + K 2 K ]} 

(C.87) 


Using from Table 1 and (G.20) , (C.87) becomes: 


J^* = tr{r, 2} + tr{r^ WUT^ + V^)C 2 C' (T^ + V^) ' 


2g X 


+ 2 C’ + V^J ' + (T^ + V^)G 2 2 Jw’} 


(C.88) 


Using a trace identity and (c.83) it is obtained that: 




as desired! 



appendix d 


Fomuilation of a specific dynamic optimization 
problem as a static optimization problem 

The following dynamic optimization problem can be posed 
static optimization problem. 

f oo 

subject tOT 

x(t+l) = A x(t) + B u(t) 
y(t) = c x(t) 
u(t) = P y(t) 

E{x(O)x‘(0)} = Xq 

E{x(0) } = 


Solution; 

Using (D.2}-(D.4) the closed loop system equation 
x(t+l) s {A + B P C)x(t) 


as a 


(D.l) 


(D.2) 

(D.3) 

(D.4) 

(D.5) 


xs: 


In compact form: 

x(t) = (A + B P C)^x(O) 

Therefore the cost functional (D.l) becomes: 


(D.6) 


(D.7) 


J{P) 


-e|I: 

( t=o 


x’ (0) (A* + C'P'B') (Q + S P C + CP'S' + C’P'R P C) 


(A + B P C)^x(O) 


(D.8) 
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Using the trace operator and interchanging it with the expectation 
operators 


I CO 

2 (A« + C'P'B’)^(Q + S P C + G'P'S* 
t=0 

+ C‘P’R P C) (A + B P C)^Xq • 


(D.9) 


Lets 


CO 

r = 22 (A' + C'P’B')^(Q + S P C + CP’S' + C'P'R P C) * 
t=0 


- (A + B P C)^ {D.10> 


Then (D.9) can he expressed ass 

min J(P^ D = tr{r X^} (D.ll) 

subject to (D.IO) . 

Analyzing (D.IO) the following identities can -be obtained s 


r = Q + SPC + C'P‘S' + C P'R P C + ^ (A’ + C*P'B’)^ • 

t=l 

• (Q + S P C + C'P'S’ + C'P'R P C) (A + B P C)^ (D.12) 

= Q + S P C + CP'S' + C’P'R P C + (A’ + C'P’B') • 

! c» 

X) (A* -r C'P'B')^ ^(Q + S P G + CP’S' + C'P’R P C) * 
t=l 

• (A + B P (A + B P C) (D.13) 

Using the following transfoirmation; 



129- 


X = t“l 


then using (D-10) » (D-13) becomes. 

C + C-S'S' C'P'K P c (R- + c'P'BMrav - B P C) 

(D.14) 


r = Q + s P 


mm 


cost functional (D-llV via the 

H^tiplier E th. problem =ansld.bed be==Bes= 

dcr, E. P) = tr{r . Ei-r + s ^ s p = - + 


Adjoining the constraint (D.14) to the 


Lagrange 


+ C'P'R P C + {A 


* + c’P’B*)r(A + B P C)]|- 


CD. 15) 


which is a 


static optimization problem. 




APPENDIX E 


4 * 

Kleinman’s Leirana and Bellman's Approximation to (A + eB} 

E.I Kleinroan's lemma [K4, Appendix P] 

Let f(’) be a trace function operating on the r x n space: 
f{x) = trace CF(x)) (E.I) 

3T2CX1 

here F(*} is a continuously differentiable mapping from R , where 

^ -X- - 4 . 

X Ixes, into K . 

If we can write; 

f(x H- eAx) - f(x) = etr{M(x) *Ax} (E.2) 

where e is an arbitrary small scalar and M(x) an nxr matrix functional 
then : 

=M'(x) (E.3) 


E.ll Discrete time version of Bellman's result on perturbation theory 

^ (A + e3) , 

for e (Bl, p. 174] . 

Problem statement: 


Find an expression for (A + SB) for e arbitrary small. 


Solution: 

’ The expression (A + 
following sequential equation: 

x(t+l) = A x(t) + EB x(t) 


is obtained as a compact form of the 


(B.4) 
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Another compact solution of (E.4) is obtained taking SB x(t) as an 
input: 


x(t) = A^xCO) + 


/t-1 

IS A" 


(T+1) 


e B x(T) 


(E.5) 


Iterating (£.5) : 


. . /t-1 

:{t) = aS(0) + ( 2 ^ 

\t=P 


-(T+1) ^ g A^x(0)j + H.O.T.(e) 


(E.6) 


If e is arbitrary small: 
x(t) = 




B aMx(o) 




(E.7) 


therefore: 


{a + EB)^ = a^ + ea^ ^ a^ } (E.a) 

T=0 ^ 

E.III Derivation of Equation (3.41): 

J{P + eAp) and J{P) can be obtained from (D.8). The increment 
J(P + eAp) - j(p) can be simplified using the discrete-time version of 
Bellman’s result given in E.II* The result obtained is as follows: 


J(P + eAE) - J(P) = 2 e 2] tr|(a' + c'p'b’)^{q + c’p'r p c + 

t=0 t 

+ S P C + CP’S') (A + BPC)^]^ (a + BP * 

T=0 

■ BAPC(A + B P C)”^X^>- + E X! tr<(A' + C’P'B')^ • 

0 ^ ^0 ^ 
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• (C’AP’R P C + CP 'RAP C) (A + B P 




{E.9) 


Using Kleinman's lemma (see F.I) 


9P 


“ t-1 f 

“ 2 X) X) ® P*C)^X (A' + CP*'B') 

t=l T=0 ( ° 




(Q -{- C'P*’R P*C + S P*C + CP* 'S') (A + B P*C) B 


2 E 

t=0 


C(A + B P*C)^X^(A’ + CP*'B')^(CP*’R + S) | 


(B.IO) 


which is equation (3.41) . 



appendix f 


On the St-ibility of a plant under 
a control law designed for an aggregated model 

Following Aoki [Al, p. 251] it can be shown that once the 
aggregated model: 


2(t) = F z(t) + D u(t) 
is stable under a control law of the form: 
u(t) = p z(t) , 
then the true model: 

x(t) = A x(t) + B u(t) 
is stable under the same control law if: 


(F.l) 


(F.2) 


(F.3) 


i) A is diagonal and tlie eigenvalues not included in the 
aggregated model are stable 

ii) the aggregated transformation is of the form; 

H - [H : 0] 

v/here H is square and full rank. 

Proof ; 

The eigenvalues of the closed loop system {F.2) -(F.3) are given 
the roots of the following equation in X: 

detrAl - (A + B P H}] = det(Xl- a] = O (F.5) 

where; 


- 133 - 


-134- 


where is the i ” Jordan Block. The Jordan Blocks from J^^j^ to J^ 
represent the "imimportant” very stable modes of the true model. 


Using (F,4) 


J . , . 
3+1 


(I : 0)B P H 


{0 : I)B P H 


(F.7) 


Therefore (P.5) becomes: 


detlXl - 


J + (I : 0)B P H 


(0 : I)B P H 


3+1 


(F.8) 


which can be reduced to; 


: XI - 


J + (I : 0)B PH* det XI - 


0 *^i 


(F.9) 


The roots of the equation: 


det ]Xl 




0 "Jl 


are all in the L.H.S. of the imaginary plane by assumption. Therefoie 
the stability test reduces to investigate the nature of the roots of: 

detlXI - (J + (I : 0)B B 5)1 

prooeeaina to anaXyzo (P.IU , let's expand tha equation (4.4) 
using (F.4) : 

F H - H A 

[F 5" : OJ = [H J I 0] 


therefore: 

F = H J 

In order co obtain (F.ll) in terms of F, (F.12) is used 

det[H(lI - (J + (I : 0)BPH))5-^J 

= detfll - (P+ (JT ; 0)B P)J » 0 

Using (4,5) and (F.4), (F.14) becomes; 
detEXi - (F + D P) 1 =0 


(F.12) 


(F.13) 

(F.14) 


(F.15) 


which gives the eigenvalues of the aggregated model (F.l) under the 
feedback (F.2). It is clear that the roots of (F.15) are in the 
L.H.S. of the imaginary plane by assumption. 



APPENDIX G 


Method to obtain the aggregated matrix tt given 
the structure of the aggregated model 

In this method it is fundamental to have a controllable true 
model as well as a controllable aggregated model. 

Method: 

Since the following controllability matrix: 

|d ; p d : ... p^"^Dj (G.i) 

is full rank and the following tv;o relations must hold: 

D = K B (G.2) 

F H = H A (G.3) 

Then, augmenting the (G.I) to the n^^^ column* and using (G.2) and 
(G, 3) ; 

h|b : AB : ... a""^b] = [D : fd : ... 

(G.4) 

Notice that in the L.H.S. of (G.4) the controllability matrix of the 
pair (A,B) is full rank and square.* 

Therefore : 


*We are assuming that rank B = 1, other\vise we shall use the Penrose 
Inverse in (G.4) for solving for H and then check if (4.6)' is 
satisfied. 
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H = j^D : F D : .. . j:® • ^ ® ’ 

In, the above derivation the following fact vjas usedi 

F*P*P *•• F D = F*P‘F ••• F H B 

= . . . F. •• • F H A-B 

- H A*A “ •* A'B (G.6) 


rt]-"- 


(G.5) 



.e 


<7 
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